Jeroline
Hello everyone.
Jeroline
Thank you for joining us today from different parts of the world.
Jeroline
Welcome to Pcloudy's webinar on beyond automation.
Jeroline
How AI designs, executes, and optimizes tests.
Jeroline
We're thrilled to have you with us today.
Jeroline
I'm Jeroline and I'll be your host for today's webinar.
Jeroline
So before we dive in, let's cover a few housekeeping rules.
Jeroline
Your lines are currently muted to ensure a smooth experience.
Jeroline
However, we encourage you to ask questions.
Jeroline
So, you can submit them using the Q&A option that you find at the bottom of your screen and we'll address them towards the end of the webinar.
Jeroline
And also note that this webinar is being recorded and we'll be sharing the recording link afterward.
Jeroline
So, feel free to share it with your colleagues or friends who may find it valuable.
Jeroline
Now, let me introduce our speaker for today, Shueb Ahmed.
Jeroline
Shabb is a QA expert with over 13 years of experience and currently the senior manager of pre-sales at Pcloudy.
Jeroline
Shy specializes in AI powered testing and help has helped numerous enterprises transform their testing strategies using AI automation.
Jeroline
DevOps and mobility.
Jeroline
He's been the forefront of applying AI in testing and brings a sharp understanding of how QA um QA is made faster.
Jeroline
smarter and more scalable with AI.
Jeroline
So without any further ado, let's welcome Shueb Ahmed.
Jeroline
Over to you Shueb Ahmed.
Shueb Ahmed
All right.
Shueb Ahmed
Thank you so much uh Jeroline for the introduction and uh hello everyone.
Shueb Ahmed
Good morning, good afternoon, good evening.
Shueb Ahmed
So so uh we've been doing a series of uh webinars around the automation and u also on the AI.
Shueb Ahmed
So today's webinar will be more focused on uh beyond automation which is where how the AI uh is playing a vital role in um in today's automation.
Shueb Ahmed
right so we'll try to understand the how the AI has been uh designs the executions and also how the tests are been.
Shueb Ahmed
So feel free to uh put in your thoughts, your questions in the chat.
Shueb Ahmed
Uh we'll try to respond at the end of this uh webinar in case if not we will try to respond it oneonone.
Shueb Ahmed
All right.
Shueb Ahmed
So with that let's get started.
Shueb Ahmed
So let's try to uh understand the evaluation of uh testing through the kits.
Shueb Ahmed
Uh right so it all started uh with the manual testing uh once this software evolution got started.
Shueb Ahmed
So everything was pretty much manual.
Shueb Ahmed
Right.
Shueb Ahmed
So the testing was something which was done manually uh multiple resources.
Shueb Ahmed
Uh so the test was done one after the other once the development cycle was completed.
Shueb Ahmed
and then the testing started.
Shueb Ahmed
So everything was something everything was done uh manually uh where we had to follow the entire process writing the test cases.
Shueb Ahmed
and then executing one by one man and obtaining the status and everything was on the excel report.
Shueb Ahmed
So there was no uh specialized tools and so on.
Shueb Ahmed
And then we evolved uh with the different methodologies that are coming into picture.
Shueb Ahmed
So one is the waterfall model uh which was um basically test being conducted in various different stages one after the other.
Shueb Ahmed
With the law again there was a lot of time because there was a dependency of to complete the um you know the previous stage unless you go.
Shueb Ahmed
to the next stage.
Shueb Ahmed
So there was a heavy dependency there but again uh there was a slight improvement when it comes to the uh waterfall methodology.
Shueb Ahmed
and then the introduction of test automation right so that's where in the uh the automation uh the the release cycles of u the softwares where took a.
Shueb Ahmed
pace uh right so with the invention of different automation solutions in the market there were uh open-source automation solutions.
Shueb Ahmed
and also some commercial automation solutions which made life easier right So uh which also reduced the uh the number of resources within the team.
Shueb Ahmed
and also helped in uh in terms of and helped in terms of reducing the overall time taken.
Shueb Ahmed
right and hence shortening the time taken right so but there was again the resource skill set uh has to be which was something which was very challenging.
Shueb Ahmed
right and then um and we moved into the agile and continuous testing along with the devops.
Shueb Ahmed
right so which was more focused on the iterative ive and incremental development in case of agile.
Shueb Ahmed
when it comes to DevOps more of uh you know integrating the development and operations thereby streamlining the the process of the software development life cycles.
Shueb Ahmed
and then we have uh then we see the inventions of AI.
Shueb Ahmed
right so with the introduction of artificial intelligence technologies like uh the machine learnings the natural language processing.
Shueb Ahmed
so everything whatever that was done repetitive everything was done through an AI based uh solution.
Shueb Ahmed
And then finally we have AI agents.
Shueb Ahmed
So AI agents are more of you know that's currently which is leading today's market.
Shueb Ahmed
right so which are more autonomous in nature uh which has its own decision keeping uh decision taking ability uh.
Shueb Ahmed
right so it gives us I mean we'll talk about the technology behind it but uh to give an overview it has its own agentic way of uh.
Shueb Ahmed
identifying the objects and elements.
Shueb Ahmed
Um so it's pretty much um um you know agile and when it comes to the decision making capability it's very much autonomy.
Shueb Ahmed
So that's something uh with the introduction of AI agent.
Shueb Ahmed
So that's something which is leading our way in the autonomous testing.
Shueb Ahmed
And now let's try to understand the uh the reality of uh automation in today's time.
Shueb Ahmed
Right?
Shueb Ahmed
So if you look at it uh everything is some everything has been done manually.
Shueb Ahmed
So there are manual triggers that happens and also when it comes to the flackiness of the test and also the script fitic that's something which is a.
Shueb Ahmed
huge burden that's something which you have been taking right.
Shueb Ahmed
So sometimes the test passes sometimes the test fails even though the code and the environment are pretty much the same.
Shueb Ahmed
So that's where we see a lot of flackiness in the test and also it resulted in high maintenance of these test scripts.
Shueb Ahmed
Right?
Shueb Ahmed
So what happens if there is a new release altogether with that.
Shueb Ahmed
so that comes up with different changes within the application.
Shueb Ahmed
So the the maintenance the maintenance was pretty much high in terms of time in terms of cost uh.
Shueb Ahmed
right where every automation engineer would spend time in identifying the changes within the application.
Shueb Ahmed
and then rewriting the scripts so that it can go ahead with the release and also the speed of releases.
Shueb Ahmed
right it's something which is very high um with the there is a lot of maintenance.
Shueb Ahmed
and then uh which is inter impacting the speed of releases um.
Shueb Ahmed
so Today in we live in very fast-paced world uh where the applications are releasing quite faster.
Shueb Ahmed
So in order to um you know match with the the speed of the technology and the invention there has to be some um solutions uh which are.
Shueb Ahmed
AI ready which are agent AI ready so which can uh take up uh the load.
Shueb Ahmed
and then you know go along with the flow.
Shueb Ahmed
So wherein we can look into terms of the quality and also in the speed standpoint and if we try to understand some of the uh key points.
Shueb Ahmed
pain points right so though the our coverage is huge but there are bugs that are getting slipped through the production uh which is in turn causing a.
Shueb Ahmed
lot of um maintenance and also unhappiness in terms of uh you know the application usage.
Shueb Ahmed
right and more of the if the if the bugs are more in the production again.
Shueb Ahmed
So that will dissatisfy the users u because of the UI and the user experience and the different things.
Shueb Ahmed
right so make making sure how to prevent these bugs getting slipped through the production that's something which you'll look at.
Shueb Ahmed
and then new releases often requires you to rewrite the scripts again.
Shueb Ahmed
right every new releases comes with a change and that requires you to create the scripts again from the scratch or at least do some maintenance activity again.
Shueb Ahmed
this led to a lot I mean lot of And when it comes to uh the CI/CD uh compatibility.
Shueb Ahmed
are we good enough to integrate with the CI/CD uh tools that are in place.
Shueb Ahmed
right?
Shueb Ahmed
So if my release is taking a longer time to u you know release and there are multiple changes within the applications where it requires you to recreate.
Shueb Ahmed
your scripts or rewrite the scripts that's where we cannot cope up with the uh you know CI/CD tools uh to to you know to be on top.
Shueb Ahmed
of it and also the the redundancy as well redundancy that's something which uh is something which we have seen as one of the key pain points […]
Shueb Ahmed
All right.
Shueb Ahmed
So what are we missing?
Shueb Ahmed
What are the missing links here?
Shueb Ahmed
So the various different things.
Shueb Ahmed
So we have highlighted few among them here.
Shueb Ahmed
One is the adaptability.
Shueb Ahmed
When it when we talk about adaptability, adapt adopting to various different technologies of the applications that is built on um.
Shueb Ahmed
and also the the traditional automation what we you know typically have.
Shueb Ahmed
right that is in place.
Shueb Ahmed
it doesn't actually understand the uh the context we are providing we are writing the scripts here.
Shueb Ahmed
right it's just the framework we create the framework from the scratch.
Shueb Ahmed
and then on top of it we write the automation code and it's pretty much we are dependent.
Shueb Ahmed
so everything human there's a lot of involvement of human here so any any changes needs to be done at the framework level or at the automation solution.
Shueb Ahmed
itself there's a human effort right and also the static scripts that we have it cannot really match with the dynamic environment environments the environments are different uh.
Shueb Ahmed
right it has to it has to adjust with different dynamic environments when we are trying to execute the scripts.
Shueb Ahmed
so this is something which we see as great one of the missing links.
Shueb Ahmed
and then finally the teams are uh spending more time in u you know in terms of managing the automation than benefiting from it.
Shueb Ahmed
right so so let's try to look at how we can bridge this gap uh and see if uh what plo solution can really help […]
Shueb Ahmed
So moving on to the next slide a quick comparison uh where we talk about u uh the traditional automation versus the agent AI testing.
Shueb Ahmed
right so when it comes to the test creation traditional automation as I mentioned earlier it's more of uh human uh testers.
Shueb Ahmed
right so where we get involved in writing uh the scripts and also start from the creation of the framework writing the test scripts.
Shueb Ahmed
and whereas when it when we talk about the agentic AI testing.
Shueb Ahmed
so this is something which has and replaced by the AI agents.
Shueb Ahmed
Though there is a minimal involvement of a human but rest everything has been taken care by the AI agents.
Shueb Ahmed
We'll look into the uh the demo once we move on how these agents really helps in uh writing the test scripts.
Shueb Ahmed
And when it comes to maintenance standpoint, as I mentioned earlier, maintenance is one of the biggest pain point.
Shueb Ahmed
right.
Shueb Ahmed
So where we are doing a manual fixes with our traditional automation there is a change in the application uh any object property level changes again it has.
Shueb Ahmed
to be reworked identify the uh the relevant text path and then you know do the changes accordingly.
Shueb Ahmed
This took lot of time.
Shueb Ahmed
So there's a lot of maintenance effort that is required.
Shueb Ahmed
Whereas aantic AI is inbuilt with some certain self-healing capability where it is intelligent enough to understand the changes within the application.
Shueb Ahmed
and then adjust the scripts accordingly.
Shueb Ahmed
Right?
Shueb Ahmed
So that's the self-healing capability that it it brings in and when it comes to decision making um.
Shueb Ahmed
so in the traditional automation it's pretty much the rule based so based on the rule that you have defined and it's very much static.
Shueb Ahmed
right.
Shueb Ahmed
So, so it's it's more more of a human based decisions what we do.
Shueb Ahmed
But whereas when it comes to agentic AI, it's more of a context aware and also goal driven.
Shueb Ahmed
It has its own intelligence which which which helps us uh which helps it taking the decision decisions very much autonomy in nature.
Shueb Ahmed
Right?
Shueb Ahmed
So and and it's very much goal driven.
Shueb Ahmed
You define the goal, it works based on the goal that are defined and learning methods with the traditional automation.
Shueb Ahmed
it's none, right?
Shueb Ahmed
So basically we write the automation scripts and then execution.
Shueb Ahmed
So there is nothing learned from it.
Shueb Ahmed
So again if you have to re re-execute or re rewrite the scripts there is no learning as such from there.
Shueb Ahmed
But whereas with agent AI it actually learns from the failures from your previous executions whatever executions that it runs.
Shueb Ahmed
and then it tries to improves the execution.
Shueb Ahmed
So every time you run your execution it learns from its failure.
Shueb Ahmed
and then it improves.
Shueb Ahmed
So thereby further helping optimizing the automation uh cycle here.
Shueb Ahmed
And when it comes to scalability, traditional automation is pretty much resource intensive.
Shueb Ahmed
You have more number of intu uh resources there.
Shueb Ahmed
You can scale up your automation.
Shueb Ahmed
But when it comes to aenti, it's pretty straightforward.
Shueb Ahmed
You don't need resources as such.
Shueb Ahmed
Right?
Shueb Ahmed
So it's very easy to scale up.
Shueb Ahmed
Uh right, given that the number of applications that you try to automate.
Shueb Ahmed
very easy enough to you know scale it.
Shueb Ahmed
So how we can uh resolve these different uh you know challenges that we have seen.
Shueb Ahmed
So Qpilot uh so so Pcloudy is AI AI based driven um automation uh software testing agumentation.
Shueb Ahmed
It it's revolutionalizing the uh the way the organizations are scaling up optimizing it and also accelerating the various different testing processes.
Shueb Ahmed
So let's try to understand uh what really uh is the solution is.
Shueb Ahmed
So so introducing Qpilot uh which is a platform agnostic automation autonomous AI agent uh for an end to-end solution.
Shueb Ahmed
So it's very much a platform agnostic be it uh any platform and Android iOS and even on the web application side.
Shueb Ahmed
and when even when it comes to the technology it's very much technology agistic be it any technology the underlying technology the applications are built on.
Shueb Ahmed
so you can seamlessly automate u not just automate but also when it comes to um maintenance standpoint we there are some inbuilt capabilities like self- failing which.
Shueb Ahmed
which in itself takes care of um the maintenance standpoint and also when it comes to the execution there are um you know smart ways of doing the.
Shueb Ahmed
test executions uh which can really help automate and optimize the automation test cycle.
Shueb Ahmed
So here's the tech behind Qpilot.
Shueb Ahmed
Uh so Qpilot it uses the agentic AI workflow.
Shueb Ahmed
So as I mentioned Qpilot agentic AI has is an uh intelligent and decision making capability than the gen AI.
Shueb Ahmed
right.
Shueb Ahmed
So when it when it comes to uh various different tasks, it starts with uh providing the natural language input uh wherein you provide the input to the.
Shueb Ahmed
Qpilot in the form of a natural language.
Shueb Ahmed
So basically we are writing down the description of my flow in simple natural language and that's something based on the interpretations and the reasonings.
Shueb Ahmed
There are different workflow generations and also workflow execution agents where based on u the learnings and the course correction it will start building your scripts.
Shueb Ahmed
and then executing instantly and then you finally see an output.
Shueb Ahmed
So we'll look into each of these various different categories in detail and um here is a quick um uh the the architecture of Qpilot.
Shueb Ahmed
So, so there has a master agent which is responsible for planning and as well as orchestrating.
Shueb Ahmed
So, it uh followed by different multiple workflow agents.
Shueb Ahmed
Each of these workflows has their own tasks that are being performed.
Shueb Ahmed
Right.
Shueb Ahmed
So for example the first uh agent which is the generation agent which will be basically looking into the DOM structure of an uh element identifying the X.
Shueb Ahmed
path and the locator followed by the code generation agent which will basically write the code based on the X part that it is retrieved from the generation.
Shueb Ahmed
code generation agent followed by a step execution agent which will execute the step which has been received from the code generation agent instantly.
Shueb Ahmed
and then followed by the error analysis agent which will spontaneously look for if there are any errors.
Shueb Ahmed
any errors that have come, right?
Shueb Ahmed
So all of these activities happen while um you know the script is being generated.
Shueb Ahmed
right.
Shueb Ahmed
So so the the accuracy with which the script is created it's very high.
Shueb Ahmed
right so you cannot really compare this with any other uh solution.
Shueb Ahmed
So so I I I'll be happy to uh take you through the demo where I'll where I can show what I'm uh referring in my slides.
Shueb Ahmed
So that's the typical architecture um on the tech behind the Qpilot.
Shueb Ahmed
So let's quickly get into the uh demonstration now.
Shueb Ahmed
I'll quickly take you through the product and uh show you how it actually works.
Shueb Ahmed
So let me get the platform.
Shueb Ahmed
All right.
Shueb Ahmed
So I have uh signed into our platform uh device.pcloudy.com which is basically a public cloud.
Shueb Ahmed
Uh it's a sharable platform.
Shueb Ahmed
So we have again when it comes to offerings uh different offerings public private onromise depending on the um uh depending on the requirement this offering differs.
Shueb Ahmed
right so I'll be showing you the demo on this uh platform.
Shueb Ahmed
so there are various different uh features and functionalities that we bring in and u.
Shueb Ahmed
so apart from mobile devices we do also have browser uh where you can test your web web based applications.
Shueb Ahmed
so more than 5,000 plus devices and browser combinations that you get to see uh which which you can do a seamless automation.
Shueb Ahmed
So now and also when it comes to automation we do have seamless integrations with all the uh traditional automations frameworks like be it APM selenium uh playright.
Shueb Ahmed
espresso and so on right so that's something which is already there where you integrate with your existing scripts.
Shueb Ahmed
and then seamlessly integrate right so that's something which is already there with the Pcloudy platform.
Shueb Ahmed
now we will focus more on the Qpilot with the advancement of AI we'll see how Qpilot actually works all.
Shueb Ahmed
right so with that let me get into the devices section and um take you through the device list.
Shueb Ahmed
All right.
Shueb Ahmed
So these are various different devices, real physical devices.
Shueb Ahmed
Um so even before you know you perform an automation, maybe you can quickly connect to a device.
Shueb Ahmed
do a quick functional validations of your applications.
Shueb Ahmed
Uh see if each and every functionality is working.
Shueb Ahmed
So again across different OS versions you can perform your test.
Shueb Ahmed
You can select the device based on these filter options both Android as well as iOS.
Shueb Ahmed
We do also support beta versions in case if there is any beta that is released.
Shueb Ahmed
So we are the first in the market to get these beta versions different OEMs all the leading manufacturers that are available.
Shueb Ahmed
So we can seamlessly uh select the device that you are looking at based on the OEMs different screen size apart from smartphones we do support tablets.
Shueb Ahmed
and fabts in case if there's any specific need where you need to connect to a tab or an iPad uh that's something which you can look for.
Shueb Ahmed
and network.
Shueb Ahmed
When it comes to networks, so we do have uh certain SIM based devices on uh different locations like in India and US.
Shueb Ahmed
and so on.
Shueb Ahmed
So where you can uh test for the SMS and calling functionalities and when it comes to data center uh we have hosted in different uh locations in.
Shueb Ahmed
India.
Shueb Ahmed
We have it in Mumbai and Bangalore, one in US, Singapore and also we have our new data center in UAE.
Shueb Ahmed
and we are also expanding towards u uh the European region as well in in the next year.
Shueb Ahmed
or so.
Shueb Ahmed
All right.
Shueb Ahmed
So, so this this so this is the place where you can see the devices and you can go ahead.
Shueb Ahmed
and then connect.
Shueb Ahmed
So before I acquire any device, let me also talk about another important section which is my data.
Shueb Ahmed
Right.
Shueb Ahmed
So my data is basically it's a cloud drive where you can upload your builds in the form of APKs and IPA file.
Shueb Ahmed
So if you have your builds in the form of APK and IPA.
Shueb Ahmed
you can pretty much connect to your local drive and can start uploading.
Shueb Ahmed
Right?
Shueb Ahmed
So that's something which you can do it as part of a prerequisite even before you get into the automation.
Shueb Ahmed
All right.
Shueb Ahmed
So otherwise if your applications are distributed across different distribution tools like uh Microsoft app center.
Shueb Ahmed
Firebase or even uh test flights for iOS, right?
Shueb Ahmed
So we do have seamless integration with these builds as well.
Shueb Ahmed
So with that, let me go back to the device list and look for any specific device.
Shueb Ahmed
Say for example if I have to connect to any specific device I can come here.
Shueb Ahmed
and then connect to a device.
Shueb Ahmed
So once I connect to a device the the entire device access is provided and you can see it's pretty much instant.
Shueb Ahmed
All right.
Shueb Ahmed
So so if you're new to cloud uh you don't really have to worry about the latency part.
Shueb Ahmed
and so on right it's pretty much instant with the invention of the technology.
Shueb Ahmed
U so so the devices will be connected uh very much instantly.
Shueb Ahmed
So once the device is acquired, I can go ahead and then perform various different um actions on my maybe if I'm looking to uh install my app.
Shueb Ahmed
I can just go ahead and then install select from the app which I've already uploaded.
Shueb Ahmed
That's something which I can do or if it is in the form of APKs and API or uh if your application is in the production.
Shueb Ahmed
you may also navigate to the play store, download the app and.
Shueb Ahmed
then uh you know pretty much install it.
Shueb Ahmed
So there are various different uh features and functionalities uh which I'll not be taking you through to in today's call.
Shueb Ahmed
Our session is more focused on the AI based automation which is Qpilot.
Shueb Ahmed
So let's get into uh Qpilot.ai and uh show you how you can actually get started with the automation with the EI solution.
Shueb Ahmed
All right.
Shueb Ahmed
So you see an option Qpilot.ai.
Shueb Ahmed
So once this option is enabled we can get into the Qpilot mode.
Shueb Ahmed
Right.
Shueb Ahmed
So now we are in the Qpilot mode.
Shueb Ahmed
So if you just try to recolct the uh the the workflow it starts with providing the natural language as an input.
Shueb Ahmed
right so that's something which will be uh we will start with.
Shueb Ahmed
so yeah so I can just go ahead and then select the app which I'm looking to automate provide the app package and app activity all.
Shueb Ahmed
right so this is something which you can get it from your app developers yeah uh since I already have it I can just select it from the.
Shueb Ahmed
list which I'm seeing and Then maybe you can provide some meaningful name to your test.
Shueb Ahmed
All right.
Shueb Ahmed
So maybe uh I just say webinari.
Shueb Ahmed
All right.
Shueb Ahmed
And now here I can provide the description in simple uh natural language.
Shueb Ahmed
Right.
Shueb Ahmed
So when I when we say natural language, so it's just the flow that you write in simple English language.
Shueb Ahmed
So I already have my test description ready on my notepad.
Shueb Ahmed
Maybe we can just quickly copy that and define.
Shueb Ahmed
So if you look at it, I'm just writing it in pretty much natural language.
Shueb Ahmed
right?
Shueb Ahmed
Entering the username in the username field, entering the password in the password field.
Shueb Ahmed
And then I can also do further validations like if I have to do some assertions or validations.
Shueb Ahmed
I can add validation command.
Shueb Ahmed
Again in a very simple language you don't have to worry about writing a line of code here.
Shueb Ahmed
and then performing various different actions right so even if there is uh a mismatch in the uh spelling of any app any any word that you provide.
Shueb Ahmed
the AI is intelligent enough to correct itself on its own right you don't have to worry about it.
Shueb Ahmed
so I have all my steps incorporated here all right I can just go ahead.
Shueb Ahmed
now provide so now you something see as as a test data.
Shueb Ahmed
right so test data is something where you test your applications with different set of data uh.
Shueb Ahmed
right so that's where the uh the uh the weightage of automation comes in.
Shueb Ahmed
right so I can always add different set of test data so I have already parameterized this.
Shueb Ahmed
right with the uh dollar sign here and then providing the value within the curly braces okay.
Shueb Ahmed
so this is the format that we will be using in case if we have to parameterize it.
Shueb Ahmed
So let me get the data here.
Shueb Ahmed
Yeah.
Shueb Ahmed
So I have my test data again.
Shueb Ahmed
I can just simply copy it.
Shueb Ahmed
Do this.
Shueb Ahmed
Maybe what I'll try to do is Yeah.
Shueb Ahmed
Or maybe I'll just try to run the with without this data here.
Shueb Ahmed
and then trigger the test.
Shueb Ahmed
All right.
Shueb Ahmed
So once I trigger the automation, my execution has been began.
Shueb Ahmed
All right.
Shueb Ahmed
So where I can um see go ahead and then see it.
Shueb Ahmed
All right.
Shueb Ahmed
So now let's try to uh recollect the architectural diagram.
Shueb Ahmed
Right.
Shueb Ahmed
So it has a master agent followed by multiple workflow agents.
Shueb Ahmed
Right?
Shueb Ahmed
So these agents will work in parallel while we are talking while the first agent will be responsible for getting the object element identifying the DOM structure.
Shueb Ahmed
and then uh getting the X path right followed by the execution uh followed by the code creation agent we will be writing the code inantly.
Shueb Ahmed
and then followed by the execution agent which will be writing the uh executing the code which has been written.
Shueb Ahmed
and then followed by the error analysis.
Shueb Ahmed
So all these four different agents will work in parallel right so and the accuracy with which the the script is created is very high.
Shueb Ahmed
right so that's where in know while you are creating the scripts you see a little longer time to create.
Shueb Ahmed
right so that's a one-time activity once the script is generated you can just seamlessly go.
Shueb Ahmed
and then execute it right so uh so so it roughly takes about 10 to 15 seconds uh to generate the script for every test for every test.
Shueb Ahmed
step right and once the execution once the step is completed you will also able to see the real-time status of your execution likewise.
Shueb Ahmed
right?
Shueb Ahmed
So, so it has gone ahead and then enter the username and.
Shueb Ahmed
then it'll go ahead and identify the username field and then followed by the validations in case if you have added uh different validations those validations can be.
Shueb Ahmed
will be taken up seamlessly right and followed by various different u uh different steps.
Shueb Ahmed
So, it's pretty seamless.
Shueb Ahmed
So, whatever code that gets been generated will be of very high accuracy.
Shueb Ahmed
That's where it you know uh it takes longer time little longer time to create the script.
Shueb Ahmed
So it's so we have done with the second step.
Shueb Ahmed
Now it is looking for a uh login button.
Shueb Ahmed
See if whether the login button exist or not.
Shueb Ahmed
Yeah I think even that is validated.
Shueb Ahmed
So we'll just go on and perform various different steps.
Shueb Ahmed
So once all these steps have been completed uh you can you know just get into the uh action to see the code.
Shueb Ahmed
right?
Shueb Ahmed
what's the what whatever the code has been created.
Shueb Ahmed
So we'll wait for it to create uh and then we can probably discuss from there on.
Shueb Ahmed
Yeah.
Shueb Ahmed
So it has yeah the login has been successful.
Shueb Ahmed
Yeah.
Shueb Ahmed
And it is validating different steps.
Shueb Ahmed
Validating if the recharge button is enabled and then finally it'll go ahead.
Shueb Ahmed
and then click on Okay.
Shueb Ahmed
So let's wait for it to uh conclude it.
Shueb Ahmed
So once this this is completed, we can navigate into the code and look at the code that is being generated.
Shueb Ahmed
Yeah.
Shueb Ahmed
So I think we are almost there.
Shueb Ahmed
We're just waiting for this to get completed.
Shueb Ahmed
All right.
Shueb Ahmed
So let this get completed.
Shueb Ahmed
In the meantime, what I can do is I can just go to the Qpilot dashboard to show you the uh the automation scripts.
Shueb Ahmed
Yeah, I have scenarios already created.
Shueb Ahmed
Yeah, I can get into the script.
Shueb Ahmed
All right, so this is how it looks like.
Shueb Ahmed
Once the uh session is once the script creation is done, you will be able to view it in the dashboard where you have an option of even.
Shueb Ahmed
you know editing the test config in case if you think you need to change the build.
Shueb Ahmed
you can just come here and then change it along with the app package and app activity.
Shueb Ahmed
So these are the various diff different descriptions that we had used.
Shueb Ahmed
All right.
Shueb Ahmed
So the username, the password, validations across all the different options and this is where you see the code.
Shueb Ahmed
right.
Shueb Ahmed
So the code is generated and uh yeah so you can just uh just go through the code validate uh all the different steps that has been created.
Shueb Ahmed
right and uh further you can copy this code as well in case if you want to take this code into your own frameworks later.
Shueb Ahmed
so that's something which we are enhancing uh this automation solution and uh.
Shueb Ahmed
right now this is in JavaScript in case if you want it in multiple set of languages we do have it.
Shueb Ahmed
so you can have it in even in Python as well or even you you name it.
Shueb Ahmed
right so that's something which is pretty straightforward and when it comes to test data uh.
Shueb Ahmed
so this is the test data that we have been used so different set of test data in case if I want to change the test data.
Shueb Ahmed
and then execute I can just go ahead and then change the data here I I need not have to create my script again.
Shueb Ahmed
right just add it in my test data and I'll I'll be good to execute all.
Shueb Ahmed
right so the code is ready now I can simply go ahead.
Shueb Ahmed
and then execute to see if all my execution whatever that has been done is flawless.
Shueb Ahmed
So I'll just go ahead and then perform the run.
Shueb Ahmed
Just hit on the run button.
Shueb Ahmed
And uh you can just simply choose few devices to see if everything is working fine.
Shueb Ahmed
Maybe I'll just try to uh execute on few devices.
Shueb Ahmed
Maybe one on Samsung or maybe one on Google, right?
Shueb Ahmed
And then run.
Shueb Ahmed
Okay.
Shueb Ahmed
Once the uh execution is initiated uh the devices will be booked from the back end.
Shueb Ahmed
And u once the devices are booked those devices will be connected and the executions of these scripts will happen parallelly on those different devices.
Shueb Ahmed
Further in case if you wish to go to the live view live session monitor it you can just get into the live session as well.
Shueb Ahmed
So in the my active session you'll be able to see the devices coming in.
Shueb Ahmed
right.
Shueb Ahmed
So um yeah I think both the devices have come.
Shueb Ahmed
Uh Samsung is already ongoing.
Shueb Ahmed
I think I can just go ahead and then connect to this device.
Shueb Ahmed
So this is more in terms of while you're debugging your automation.
Shueb Ahmed
right not necessary every time you know you view your you monitor your execution but this is something where you know while you're creating the scripts for the.
Shueb Ahmed
first time and then would like to do a monitoring right so.
Shueb Ahmed
so the execution has already began as you can see uh it has started on one of the devices which is on Samsung F42 yeah.
Shueb Ahmed
and uh yeah it's started even on the other device so it'll happen seamlessly on both the devices devices at the same time.
Shueb Ahmed
Right?
Shueb Ahmed
So thereby even achieving from the parallel execution standpoint you can execute on any number of devices.
Shueb Ahmed
Right?
Shueb Ahmed
So theoretically there is no limit as such we have even executed on more than 20 devices at a given point.
Shueb Ahmed
All right.
Shueb Ahmed
So provided you have those number of licenses you can just simply go ahead.
Shueb Ahmed
and then execute.
Shueb Ahmed
So this is live monitoring uh where you can monitor your session.
Shueb Ahmed
Further in case if you wish to uh interact with the device in case if there is a need we have an option where you can enable the.
Shueb Ahmed
interaction and just simply go ahead and then you know interact with the device.
Shueb Ahmed
right so this will help you if there are any unwanted pop-ups that you want to close it off while the execution is happening or want to input.
Shueb Ahmed
any data you can use this enable interaction all right so now the execution has been completed seamlessly on both the devices okay.
Shueb Ahmed
so the devices will go for release automatically and in the meantime I can go and.
Shueb Ahmed
and then monitor my reports as well.
Shueb Ahmed
Okay, so these reports are realtime reports, right?
Shueb Ahmed
So while the execution is going on, you can still go and.
Shueb Ahmed
and then monitor your session, right?
Shueb Ahmed
So that helps you understand how many number of test cases that are passed.
Shueb Ahmed
how many number of test cases that are failed.
Shueb Ahmed
So all of the different status you will be able to uh monitor it.
Shueb Ahmed
right?
Shueb Ahmed
So these are the two devices which we have run.
Shueb Ahmed
So overall in case if you are running it uh on multiple set of devices uh you'll be able to see the status of your build along with.
Shueb Ahmed
how many number of test cases that are passed number of test cases that are filed in case if there are any tests that are in progress you'll.
Shueb Ahmed
be able to see it further you can deep dive into each of these test cases uh to understand at the test test case level.
Shueb Ahmed
right along with the status of it and we're also providing you the entire uh test logs here.
Shueb Ahmed
right so which helps you identify what are the cap pip capabilities the inputs that you have provided along with the output that that you that you are.
Shueb Ahmed
capturing right so you can get that so this is something which you get it even while the execution is going on.
Shueb Ahmed
and then followed by the uh device logs and APM logs so this will take some time uh to load uh maybe I can just show you the.
Shueb Ahmed
ones which you have already executed some time back where you would be able to see all the execution status in real time yeah this one […]
Shueb Ahmed
Yeah, here you have the logs here and also the uh the session video.
Shueb Ahmed
So the session video is captured in case if you wish to see how the execution actually went ahead.
Shueb Ahmed
right and you would like to share this with your developers.
Shueb Ahmed
Uh so you know the session is also captured and in case if you wish to download these logs you can uh download it on your machines as.
Shueb Ahmed
well.
Shueb Ahmed
All right.
Shueb Ahmed
So that's how the uh report looks like and these reports are sharable.
Shueb Ahmed
You may simply uh click on share link.
Shueb Ahmed
Report link gets created.
Shueb Ahmed
Just share it with your different stakeholders if you want to quickly update them.
Shueb Ahmed
Uh they need not be Pcloudy user.
Shueb Ahmed
So the idea here is to help um uh you know collaborate the findings with different teams u you know pretty fast.
Shueb Ahmed
All right.
Shueb Ahmed
So that's more on the reports.
Shueb Ahmed
Right.
Shueb Ahmed
So this is something which we have done an execution on a particular test case that we had created.
Shueb Ahmed
Now what if if I have multiple set of test cases and it would like to run as a test suit.
Shueb Ahmed
right across multiple uh platforms.
Shueb Ahmed
There is something called as collection.
Shueb Ahmed
All right.
Shueb Ahmed
So where we go ahead and then define my collection.
Shueb Ahmed
And I can define my own collection uh like what are the scripts that I want to choose uh across multiple platforms web automation.
Shueb Ahmed
and even API is something which we are going to bring it and you can define all the uh collection details here the name of the projects.
Shueb Ahmed
and everything.
Shueb Ahmed
So I have already created a collection here uh just for the benefit of the time maybe I can just quickly run through how my collection looks like.
Shueb Ahmed
So I have provided some meaningful name to my uh collection and yeah.
Shueb Ahmed
so these are my automation scripts that I have already created right I can just go ahead.
Shueb Ahmed
and then insert these different uh uh test cases which I want maybe from mobile automation or even from web automation I can just seamlessly add it.
Shueb Ahmed
and yeah so once I define the uh test cases I can just further go ahead.
Shueb Ahmed
and then configure uh there's something called as configuration as well right I'll talk about that.
Shueb Ahmed
Uh so you can choose configurations.
Shueb Ahmed
These configurations are basically uh in case if there is any uh different build that you want to run.
Shueb Ahmed
So you define a configurations uh with different uh application details and.
Shueb Ahmed
then you select by know during the run during before you run your collection.
Shueb Ahmed
That's something which you can choose if I've already defined and then you define the devices on which you want to run.
Shueb Ahmed
right.
Shueb Ahmed
So maybe you're looking to run on a specific OEMs.
Shueb Ahmed
You select the OEM here and provide the range of version version range basically.
Shueb Ahmed
right.
Shueb Ahmed
So for example, if I'm looking to execute maybe from 12 to 14.
Shueb Ahmed
and then I'll define it maybe you know pick some five devices from Samsung model.
Shueb Ahmed
So it'll just pick up some five different devices from Samsung with the versions from 12 to 14.
Shueb Ahmed
and then it'll execute simultaneously you know at the same time.
Shueb Ahmed
And if in case if you have any browser based automations, if you have created your web automation scripts.
Shueb Ahmed
then you will also go ahead and then define what browser that you're looking at whether it's a Chrome.
Shueb Ahmed
Firefox, Edge, Safari across different OSS uh be it Mac or Windows.
Shueb Ahmed
and then you select how many number of Windows machines or how many number of Mac machines that are needed.
Shueb Ahmed
right so you define the all set all the collections at one place.
Shueb Ahmed
and then you go ahead and then trigger the test.
Shueb Ahmed
So, so once you run the entire suit as a suit gets triggered.
Shueb Ahmed
right?
Shueb Ahmed
So, you'll see a lot of time here again, right?
Shueb Ahmed
So, we have web automation scripts, you have mobile automation scripts, you have APIs.
Shueb Ahmed
uh everything at one place, right?
Shueb Ahmed
So, you know, we are bringing it everything in one place and with a single uh reporting structure.
Shueb Ahmed
right?
Shueb Ahmed
So, that helps further um you know um optimize your automation cycle.
Shueb Ahmed
So once the execution is completed you will be able to see the uh reports as well.
Shueb Ahmed
So similar reports so you can get into a particular um uh test suit level of reporting where you can deep dive into each of the various different.
Shueb Ahmed
devices that you have tested different browsers in case if you have asked.
Shueb Ahmed
So everything we will be able to see it here.
Shueb Ahmed
So this is one of the scenarios for a web use case.
Shueb Ahmed
All right.
Shueb Ahmed
So where we are executing a web automation scripts that's something which you can see it here.
Shueb Ahmed
Yeah.
Shueb Ahmed
along with all the different key parameters.
Shueb Ahmed
Yeah.
Shueb Ahmed
So this is on the mobile application.
Shueb Ahmed
Yeah.
Shueb Ahmed
So so this is at the uh test suit level.
Shueb Ahmed
All right.
Shueb Ahmed
So so this is something where you go ahead and then uh trigger it.
Shueb Ahmed
All right.
Shueb Ahmed
And further uh we I spoke about configuration.
Shueb Ahmed
So I'll just quickly take few more minutes here to brief what configuration actually is.
Shueb Ahmed
So configuration is basically defining certain prerequisites, right?
Shueb Ahmed
So you might you might have different environments, different uh builds together.
Shueb Ahmed
right?
Shueb Ahmed
So you go ahead and then predefine it, keep it ready.
Shueb Ahmed
uh so define some name meaningful name and then start providing the the URL of a web application in case if it's a web.
Shueb Ahmed
and on the mobile side you can define the application which particular mobile app that you're looking at select the app package app activity accordingly.
Shueb Ahmed
and then you save it so you will be using these different uh configurations while you're executing it.
Shueb Ahmed
So I've already configured one and I'll just quickly take you through one.
Shueb Ahmed
Yeah.
Shueb Ahmed
So this is the uh web one, the iOS and also in the Android side.
Shueb Ahmed
So you you configure this and then you select during the runtime when you're executing as part of your test.
Shueb Ahmed
So these are the various different um uh features couplet brings in and we are also rolling out um the new uh.
Shueb Ahmed
and some enhancements like which will incorporate.
Shueb Ahmed
So for example, you don't have your build at all, right?
Shueb Ahmed
So and you want to create your automation test scripts uh by using the Qpilot.
Shueb Ahmed
So we have an approach um I I think this was done in our previous webinar as well uh where you can define the description um.
Shueb Ahmed
and in a specific format and then rest the scripts gets created even if you don't have a build.
Shueb Ahmed
right.
Shueb Ahmed
So when you get a build it's all about just adding the build.
Shueb Ahmed
and then during runtime.
Shueb Ahmed
So during the runtime what it happens is based on the application that you have selected it will go.
Shueb Ahmed
and then uh use the uh description and start writing the code once the application is ready.
Shueb Ahmed
So basically you know we are going towards shift left.
Shueb Ahmed
So even before the application is ready you can just go ahead.
Shueb Ahmed
and then design it right so that's one of the use case and the other use case is more of a um you have an application.
Shueb Ahmed
but you are expecting some changes in your new build.
Shueb Ahmed
Right?
Shueb Ahmed
So maybe an add toart button in the pre there is no add to cutart in the previous build.
Shueb Ahmed
but in my new build there is an add toart.
Shueb Ahmed
So whatever uh changes that you anticipate you can incorporate this within your existing build itself even with.
Shueb Ahmed
so for example if in my previous build I don't have an add toart I can still go ahead.
Shueb Ahmed
and then write my test cases for add to cardart so based on the figas that you get from your uh from your uh developers or from the.
Shueb Ahmed
design engineers right so uh so different so this is one of the most common used scenario.
Shueb Ahmed
right so where you expect and see the changes within your application that are coming in.
Shueb Ahmed
So during the runtime what happens is whatever whatever description and the code that is created it goes ahead.
Shueb Ahmed
and then during the runtime it it writes the code during the runtime.
Shueb Ahmed
So that kind of flexibility brings that will help further save a lot of u uh your test uh time.
Shueb Ahmed
right overall in in in case of an automation standpoint.
Shueb Ahmed
All right so that's more of uh on the Qpilot side uh maybe I'll just quickly run you through the web automation as well.
Shueb Ahmed
Um so I just wanted to show we will just not run but yeah I can just take you through how it all looks like define the URL.
Shueb Ahmed
provide all the descriptions simple English language and then the code is again generated.
Shueb Ahmed
right so which you can have a look at it you can you can even copy the code.
Shueb Ahmed
and then run it on the PQD platform as well directly select the required number of uh browsers that you want to run.
Shueb Ahmed
and then execute it seamlessly all right so That's something uh that's all about Qpilot.
Shueb Ahmed
Uh it has lot many capabilities and you might see some more enhancement that are coming uh on the Qpilot standpoint.
Shueb Ahmed
All right, I think uh that's it.
Shueb Ahmed
Um I can take up the uh question answers if there are any.
Shueb Ahmed
Maybe I'll just quickly go back to the slides.
Shueb Ahmed
Yeah, maybe I quickly summarize uh what all you can do more with Qpilot.
Shueb Ahmed
So validation assessions.
Shueb Ahmed
So this is something which we've already seen.
Shueb Ahmed
So in between every step if you have to do some validation assertion that's something which you can add it test data and parameterization.
Shueb Ahmed
If you have to run it with multiple set of uh test data uh and parameterize it.
Shueb Ahmed
so that you can with every execution you use different set of data.
Shueb Ahmed
and then run it uh across platforms.
Shueb Ahmed
It's not just limited to one specific platform but across multiple platforms Android iOS web applications and you run it all the platforms across together at once in.
Shueb Ahmed
in the form of a test suit.
Shueb Ahmed
Yeah, you can also define the configurations that we which is something which we've already seen uh.
Shueb Ahmed
so that you are ready for your future executions with the test config that you're looking at and orchestration is something more of distributing the test more intelligently.
Shueb Ahmed
So that's something which is inbuilt on part of Qpilot which has its own intelligence of distributing their test on different devices.
Shueb Ahmed
and browser combinations more intelligently further optimizing the automation test cycle.
Shueb Ahmed
All right with that uh I open up for a uh Q&A session.
Shueb Ahmed
So if there are uh any questions please feel free to go ahead.
Shueb Ahmed
I'll be happy to answer your
Jeroline
Uh here's a question for you Shueb Ahmed.
Jeroline
Uh how different is this from cloud desktop plus uh playright uh MCP setup?
Shueb Ahmed
Uh you cannot really compare this with any uh traditional uh automation solution.
Shueb Ahmed
Uh right.
Shueb Ahmed
So while uh the underlying technology and the script that it generates it's um it looks similar at the back end.
Shueb Ahmed
but the from the front end standpoint the the tech that Qpilot uses it's more of an agent AI uh.
Shueb Ahmed
so based on the intelligence that the AI has it goes ahead reads the description.
Shueb Ahmed
and then creates the script right so whereas in the traditional automation uh be it playright or any other automation framework.
Shueb Ahmed
right so where you have a right skill set of a particular ular language.
Shueb Ahmed
and then you go ahead and then write the code.
Shueb Ahmed
All right.
Shueb Ahmed
So that's the difference is you're not really bothered about writing the any line of code here.
Shueb Ahmed
You're just providing the description and the rest the Qpilot does for you.
Shueb Ahmed
Right?
Shueb Ahmed
So that's the that's a quick automation, right?
Shueb Ahmed
You're you're really not bothered about what code that you're writing it.
Shueb Ahmed
right?
Shueb Ahmed
So the code is all been written by the AI and with very high accuracy.
Shueb Ahmed
Whereas in in in terms of the traditional automations like playright or whatever solution that you use your you there is a dependency here with the rights resource.
Shueb Ahmed
skill sets and also the code that you write has to be really accurate.
Shueb Ahmed
right so that's one of the typical uh differences you tend to save a lot of time with uh Qpilot.
Shueb Ahmed
right so while the traditional automation still exist you can still go ahead.
Shueb Ahmed
and then execute your automation it's not a replacement but yeah it can speed up your automation life cycle uh with the evaluation of AI.
Shueb Ahmed
Uh and also there's one more question is load testing possible with Qpilot?
Shueb Ahmed
Um I mean load testing is more of a functional testing right load testing where we predominantly get into um you know uh identifying the number of users.
Shueb Ahmed
and then concurrently running it to see the how my application behaves the transactions from the transaction response time as well.
Shueb Ahmed
So Qpilot is more into a functional so we are validating the functionality it's not a load testing tool.
Shueb Ahmed
right.
Shueb Ahmed
So there are different tools for load testing but this is focused more on functional
Jeroline
Got it.
Jeroline
And uh does pilot also learn from past bugs or test results?
Shueb Ahmed
Yeah.
Shueb Ahmed
So uh as I mentioned earlier in my slides, it has its uh capability of learning from its uh failures.
Shueb Ahmed
whatever executions that it has done, it has its own uh capabilities to learn from the previous uh runs.
Shueb Ahmed
and then improve your uh the other test runs that you do.
Shueb Ahmed
Right?
Shueb Ahmed
So based on the all the uh the the tech that is being used behind the scenes.
Shueb Ahmed
it has its own intelligence and then you know it reads from the failures and improves your test automation overall.
Shueb Ahmed
Yeah.
Jeroline
Okay.
Jeroline
Okay.
Jeroline
Got it.
Jeroline
And there's also one more question.
Jeroline
So can AI adapt to UI changes automatically or uh does it require any retraining?
Shueb Ahmed
All right.
Shueb Ahmed
So I we spoke about self-healing.
Shueb Ahmed
All right.
Shueb Ahmed
Self-healing is something which is incorporated within uh Qpilot, right?
Shueb Ahmed
So it it has its own intelligence of identifying the changes uh within the application.
Shueb Ahmed
So if there is any changes at the object property level so it can automatically identify those changes and um you know and your scripts are healed there.
Shueb Ahmed
Now when it comes to UI right so we have gone beyond and also supported UI.
Shueb Ahmed
So while there are many places where the UI changes uh right from maybe from add to cutart to something else u.
Shueb Ahmed
so there is a capability which can be added all right so uh.
Shueb Ahmed
so that's something which can be incorporated all right so while the self-healing agent itself can work as an independent agent can be incorporated into your existing automation.
Shueb Ahmed
frameworks as well you need not necessarily run with Qpilot but self-healing as an agent can be incorporated with your existing automation framework with a capability which will.
Shueb Ahmed
take care of UI changes as well as uh object property available changes.
Shueb Ahmed
But when it comes to Qpilot, it is uh incorporated within QT where it goes ahead.
Shueb Ahmed
and then identifies the changes and then heals your script
Jeroline
Right.
Jeroline
Okay.
Jeroline
And there's one last question before we close for today.
Jeroline
Um can we control or review the test cases that are generated by Qpilot before it's executed?
Shueb Ahmed
Yeah, absolutely.
Shueb Ahmed
I mean uh that's something uh which can be done.
Shueb Ahmed
Uh there are different u approaches again uh which can be uh adopted.
Shueb Ahmed
All right.
Shueb Ahmed
So even before you're running your test, you may have to cut short the uh number of test cases.
Shueb Ahmed
You can just u you know append those changes within the descriptions that you provide.
Shueb Ahmed
and then uh you know you trigger your trust, right?
Shueb Ahmed
So that will something which will incorporate and then you basically recreating the script all together.
Shueb Ahmed
right?
Shueb Ahmed
So this can be done yeah in while you're while you're uh you know updating your scripts or changing any test cases from the description that you have.
Shueb Ahmed
already written.
Jeroline
Okay.
Jeroline
Okay.
Jeroline
Okay.
Jeroline
So that brings us to the end of today's session.
Jeroline
Uh big thank you to our speaker Shueb Ahmed for sharing such valuable insights and to all of you for being an engaged and interactive audience.
Jeroline
Uh if we couldn't get to your question today, don't worry.
Jeroline
You can always reach out to us at info@pcloudy.com or connect with us on LinkedIn.
Jeroline
Uh and also as a quick reminder, uh the session has been recorded and we'll be sharing the uh link with you soon.
Jeroline
So feel free to visit uh revisit the discussion or share it with your colleagues and friends.
Jeroline
So stay tuned for our upcoming webinars and be sure to follow us on LinkedIn for more updates on AIdriven testing.
Jeroline
automation, and industry best practices.
Jeroline
Until next time, happy testing.
Jeroline
Have a great day.
