Anshuman Chatterjee
Hello I welcome you all for the webinar thanks for joining in today's topic is can AI be used to simplify the process of test
Anshuman Chatterjee
Creation it will be one hour session with 40 to 45 minutes of presentation and demo followed by around 15 to 20 minutes of Q&A
Anshuman Chatterjee
So if you have any questions please send them to us using the questions tab on your GoToWebinar control panel hi I am Anshuman Chatterjee a
Anshuman Chatterjee
Tagine I'm a lead developer and automation architect at peach laude which is a part of smart software testing solutions I have close to eight
Anshuman Chatterjee
Years of experience and have been involved in automation tools and framework reiation as a developer moreover I have been responsible for the creation of
Anshuman Chatterjee
All the PLD plug-ins for third-party tools so without spending any further time let us move on to the agenda for today
Anshuman Chatterjee
So the first will be a brief introduction for Pcloudy and then we'll try to have a small differentiation between what is VI and
Anshuman Chatterjee
What is ml then we'll see some day-to-day tools that are AI base we use them daily but without even recognizing and they are based
Anshuman Chatterjee
Upon the artificial intelligence then we will see what are the five stages of building and a eyewear application
Anshuman Chatterjee
Then you will try to identify some of the mobile icons using a machines and see what if the machine is wrong then we'll try
Anshuman Chatterjee
To write a simple test case like a manual tester and its execution
Anshuman Chatterjee
Pcloudy is a leading mobile testing platform for developers as well as some testers they can test their application on targeted region specific smartphones
Anshuman Chatterjee
And networks we are close to 500 plus Android as well as iOS devices and 7,000 plus developers and testers around the globe trust us
Anshuman Chatterjee
We are the market guide for mobile app test automation tools as per Gartner
Anshuman Chatterjee
We have our data centers at four locations including India the United States Australia and Philippines
Anshuman Chatterjee
So what is AI and what is ml so AI is a technique which enables machines to mimic human behavior what is mimicking human behavior
Anshuman Chatterjee
It means an AI machine can think like a human it can work like a human and it has the power to take its own
Anshuman Chatterjee
Decisions and above all learn from his mistakes provided a proper feedback is given it is very similar to a child learning to walk for
Anshuman Chatterjee
The first time whenever the child Falls he learns what he did wrong and tries to be more cautious second time machine learning however is
Anshuman Chatterjee
A subset of AI the tous machine learning and AI are often used interchangeably but machine learning is a subset of AI which uses statistical
Anshuman Chatterjee
Methods to enable machines to improve with experience it is an application of AI that provides system the ability to automatically learn and improve from
Anshuman Chatterjee
Experience without being explicitly programmed machine learning focuses on development of computer programs that can access data and use it to learn for themselves
Anshuman Chatterjee
With the advancement in technology we are already connected to AAA in one or the other way whether it is Siri on an iPhone or
Anshuman Chatterjee
Alexa on your Amazon or Cortana on a Microsoft phone yes the technology is in its initial phase and more and more companies are investing
Anshuman Chatterjee
Resources in machine learning indicating a robust growth in AI products and apps in the near future in the next few slides I will be
Anshuman Chatterjee
Showing you some tools that we use in our day-to-day life without recognizing that they are AI wastes
Anshuman Chatterjee
So recently we see there is a feature of smart replies in Gmail
Anshuman Chatterjee
See this image where I have got an email from Karen where the subject line is pretty weird it just says yes and then the
Anshuman Chatterjee
Body contains no solid ation but just thanks yes let's do it and then it contains a weird URL which doesn't make me means anything
Anshuman Chatterjee
And in the signature it is just mentioned sent from my LG mobile and
Anshuman Chatterjee
Gmail suggest me to reply with one of the three suggestions let's do it or I am in earnest no longer available so here we
Anshuman Chatterjee
Can see that Gmail has suggested me to positive replies let's do it or I'm in and one negative reply as well it's no longer
Anshuman Chatterjee
Available so how does Gmail does it so Gmail has close to millions and millions of small number okay billions even a smaller let's say
Anshuman Chatterjee
Lost and lost of data lost the loss of emails Google Mail has and it has analyzed them and it has created model well by
Anshuman Chatterjee
Analyzing the body and the subject 9 it knows what are a typical replies to these types of emails and the first three or four
Anshuman Chatterjee
Most prominent replies it's a respect to us the next is the mail follow-up reminders again in Google Gmail
Anshuman Chatterjee
So here I got a mail a few days back from Heidi asked she asked me to hi could you help me with some images
Anshuman Chatterjee
On the website and I didn't care to reply so Google asked me okay this main was received three days ago do you want to
Anshuman Chatterjee
Reply so Jimin knows that the person Heidi she wants me to reply with something on her email so this is similar to a sentiment
Anshuman Chatterjee
Analysis so Gmail knows the sentiment of this email and there that's why Gmail is registering me to reply as I have not replied free
Anshuman Chatterjee
In the last three days chat was chat BOTS are very common these days whenever we go to some support section of an application or
Anshuman Chatterjee
Web site we are greeted by this small chat BOTS application so here's a small example from a hair stylist so I just said hi
Anshuman Chatterjee
So the reply was hi Owen so probably my number was already disturbed with this is stylist that's why the bot no knew that my
Anshuman Chatterjee
Name is Owen so the reply was hyerin welcome to the soho stylist booking bought demo by loyalty bots try me which service would you
Anshuman Chatterjee
Like to book so I replied this is a normal messenger mint so cut and blow-dry euro 50 okay which day the boss I reply
Anshuman Chatterjee
To stay 10th January and then the bot says what
Anshuman Chatterjee
So I said okay sixteen and my booking is done so I never interacted with a human I just interacted with a bot and the
Anshuman Chatterjee
Bot was using NLP probably in the back end and it's new that I need what type of vehicle and when and on what date
Anshuman Chatterjee
I wanted the booking on and it worked the timeslot and said that I'll send you a reminder here the day before great that was
Anshuman Chatterjee
A chat bot okay where else we see a lot of product recommendations in Amazon Flipkart
Anshuman Chatterjee
Alibaba so all these things are just they are also bi so
Anshuman Chatterjee
Amazon knows that customers who bought maybe a earphone they are also interested in buying a case for the head headphones or the charging adapters
Anshuman Chatterjee
Or some similar headphones for the partner maybe so all those recommendations this amazon is me making us there is also a a what else
Anshuman Chatterjee
Again trafficked is in Google Maps so here I wanted to go from Ruby Steiner to these galleries and this was just a - -
Anshuman Chatterjee
Of distance and Google's has stood me that it will take four minutes what will it take four minutes for this two mice because there
Anshuman Chatterjee
Was a traffic this traffic was a moderate traffic so it showed me the blue line and wherever there was a traffic it should mean
Anshuman Chatterjee
Orange hadn't been a traffic jam or a heavy traffic area it would have showed me in red so how does Google knows it that
Anshuman Chatterjee
Where today's jam on where there is a slow-moving traffic so Google has again lost and loss of data maybe Google knows that this time
Anshuman Chatterjee
Period there's typically a slow movement of traffic or maybe it is aligning its weather forecasts in that area or maybe it knows that there
Anshuman Chatterjee
Is a signal that there's a traffic light over there so we're combining all these inputs all these data and processing it Google has created
Anshuman Chatterjee
An awesome model which can help us with directions as well as the times and traffic information
Anshuman Chatterjee
Then all of us we use cabs whether it's uber or something else so uber provides me a competitive pricing for cab journeys so uber
Anshuman Chatterjee
Exactly knows where am i standing by creating a location-aware app and uber knows that a person standing and the airport is willing to pay
Anshuman Chatterjee
A higher price for that five miles of journey rather than a person who is standing at a bus stop
Anshuman Chatterjee
So this again uber has collected a lot of data a typical riding pattern and then uber can quote me different prices for the same
Anshuman Chatterjee
Journey then commercial airlines okay so he might be surprised to discover how little flying your friendly pilot actually does in the cockpit a survey
Anshuman Chatterjee
Of the airline Boeing triple7 reported Pallas spend only seven minutes manually flying the plane during a typical flight with much of the rest being
Anshuman Chatterjee
Done by AI technology so I hope this AI demo goes well otherwise many of you might might rethink replan your journeys was like but
Anshuman Chatterjee
Just chill it's all controlled don't give that look to the to your pilot and the next time you see them let's talk about Facebook's
Anshuman Chatterjee
Proactive detection so in member 2017 Facebook launched a proactive protection feature that is can suppose to detect patterns that may indicate if a user
Anshuman Chatterjee
May be considering self-harm when it detects suicidal thinking patterns the AI powered programs sends mental health health resources to the person and sometimes also
Anshuman Chatterjee
To his friends so Facebook's supposed to say a program with human resources such as trained moderators partnership with local mental health organizations and local
Anshuman Chatterjee
First responders when appropriate so see the beauty you post anything in facebook and it is just analyzing your data continuously
Anshuman Chatterjee
Facebook knows that if a people if a person is in a societal state what types of websites or what types of references of what
Anshuman Chatterjee
Types of posts does the people that the person does so by analyzing all those data
Anshuman Chatterjee
Facebook can actually prevent someone who is suicidal by sharing the information with his friends and family keep interest so it can find the thoughts
Anshuman Chatterjee
That you need so people's some random people can just put pin in their thoughts and it Pinterest knows okay what is your mood today
Anshuman Chatterjee
And what will you want to see it can show you the perfect addition sashimi it can listen to a portion of music playing in
Anshuman Chatterjee
Your background to find out the song album artist so
Anshuman Chatterjee
What do you think so is a I'm just measuring the frequencies and the amplitudes of whatever wav file whatever mp3 file it's playing in
Anshuman Chatterjee
The background and it is matching with all the available mercy database no it's not doing that it's probably converting the music that it sees
Anshuman Chatterjee
Into different Jonah's different album the artists were the male or female what is the ethnicity of the music and then it's trying to filter
Anshuman Chatterjee
Out okay what there were some music it was playing in the background last one is extra feature Amazon Prime this is my personal favorite
Anshuman Chatterjee
So whenever you pause an Amazon Prime video it shows you the information about the cast the characters music photos and other bonus materials which
Anshuman Chatterjee
Are present within a few frames of the video where you have Faust's so here in the example as pause the season 1 episode 1
Anshuman Chatterjee
Of Tom Clancy's Jack ran in 33 minutes 8 seconds and whatever the characters are there in the screen you can get all the details
Anshuman Chatterjee
Along with the casts and some general trivia and music information is also shown if there if that is a music file so this we
Anshuman Chatterjee
Can figure out that it is showing some it is doing some sort of image processing in the backend but yeah this feature is pretty
Anshuman Chatterjee
Cool now let us see how an a platform can be build so building an AI platform is a five step process so get data
Anshuman Chatterjee
This the most toughest of all things that I feel because you just don't have to get data you have to gather lots and lots
Anshuman Chatterjee
Of data then you have to prepare it according to your model then you have to pray in the model then you have to just
Anshuman Chatterjee
Test your model with the sample data where you already know the answer and check wherever the model has performed good and whoever the model
Anshuman Chatterjee
Has performed bad and then you have to learn and improve
Anshuman Chatterjee
When I say learn and improve the model is getting improved so far example I can feed in a lot of data about the Apple
Anshuman Chatterjee
Watch this color what is shape how does it looks like what is taste like and some other fruits as well and then ask my
Anshuman Chatterjee
A system whether this is an apple okay probably it should be able consider this is an apple and maybe after some more dates of
Anshuman Chatterjee
More sessions of training I can ask the model about the Apple computers logo that whether this is an apple and then it's the beauty
Anshuman Chatterjee
Of your model is perfect enough to giorgia this tool looks like a an apple
Anshuman Chatterjee
Next we have created a small video where we try to identify a few images that are frequently used in mobile application domain we have
Anshuman Chatterjee
Collected tens of thousands of apps from android and iOS application stores and tried to fetch out the object properties along with the images we
Anshuman Chatterjee
Have tried to Crane over a a we have tried to train our AI baby to walk fall and rice now let's try to identify
Anshuman Chatterjee
Some common images using the machine so I've already mentioned my server end point and
Anshuman Chatterjee
This is the image folder which contains lots of random images so I'll just start the video since the folder now I'll start the test
Anshuman Chatterjee
So this is a draw which I think there is a water drop and the AI also thinks that there is a drop and with
Anshuman Chatterjee
A 96% accuracy next is sir contacts with 98% accuracy this again is the contacts good night time person this looks like a date or
Anshuman Chatterjee
A calendar and 6% this looks like a message edit message ok the percentage has dropped 89% now this is a card shopping cart yes
Anshuman Chatterjee
There's a drop again ok let's check out another one there's an edit okay yeah there's an edit image this again is an edit image
Anshuman Chatterjee
With an 85 percent of accuracy what about this hey things with 81 percent of surety that was an edit still the shopping cart okay
Anshuman Chatterjee
62 percent there's a contacts okay this again it's a shopping cart
Anshuman Chatterjee
Okay what does a thinks he thinks is a document no there's not a document let us provide a feedback pad computers pad pad computer
Anshuman Chatterjee
There's not a document there's a contacts icon okay the good thing is the AI now says sorry master I will perform better next time
Anshuman Chatterjee
Okay now let us start giving the AI model feedback so with more and more feedbacks okay that this is good and this is bad
Anshuman Chatterjee
This your decision is here your decision is correct here your decision is mad
Anshuman Chatterjee
So the AI model gets improvised so this is the preening or the feedback that we were talking about so with more and more training
Anshuman Chatterjee
This layer gets trained and this layer gets better so as we are talking my model in the backend is continuously getting trained and it's
Anshuman Chatterjee
Getting better so probably the next time I'll try out with the similar images we are for showing a lesser percentage maybe 80% it will
Anshuman Chatterjee
Show it should show a better accuracy okay so here we learn that it's very important for of an AI application this gets proper feedbacks
Anshuman Chatterjee
So if it's correct you should stay good computer is like it like you are trained your dog or your pet and if it is
Anshuman Chatterjee
Not you have to provide a feedback that bad comes with us okay let's move to another slide so here
Anshuman Chatterjee
We have written a simple test case that a manual tester will create
Anshuman Chatterjee
So the simple test case looks like an initialize application open application then click on the menu hamburger button maybe wait for the guest user
Anshuman Chatterjee
If there's no logged in user then click on the home icon then maybe if there's a search text box and type Pcloudy maybe
Anshuman Chatterjee
Click on View all offers there may be stripe up to big billion day then click on billion via OCR click on back button so
Anshuman Chatterjee
This is what typically a manual does to will create so we have got some key words like lick weight type swipe initialized and then
Anshuman Chatterjee
We have some objects where we have to perform the action on and now the AI should the AI engine whatever we have whatever we
Anshuman Chatterjee
Want to test our applications on it should be intelligent enough to create something out of it
Anshuman Chatterjee
Ok so what's next question can a machine execute the previous test case
Anshuman Chatterjee
Let me go back to the previous test case click on the menu hype hamburger icon wait for guest user click on whom do you
Anshuman Chatterjee
Think a machine can execute it it's show time let's see
Anshuman Chatterjee
You so here I'm seeing and a pickle Audi device
Anshuman Chatterjee
This is a real pickle device and I have already installed the application which is sort of instrumented over here so there is a sample
Anshuman Chatterjee
Application that we have created so I also have a simple Java program that I will put over here and try to give the inputs
Anshuman Chatterjee
One by one okay so as a manual tester what do we see
Anshuman Chatterjee
So maybe as a manual tester I want to click on the mobile icon click on the mobile icon
Anshuman Chatterjee
So as soon as I press ENTER it should actually process what type of sentence is this what type of key word is actually used
Anshuman Chatterjee
And it should try to find fill the mobile icon is
Anshuman Chatterjee
So this should be pretty simple right yep it has clicked the mobile icon let's go back now
Anshuman Chatterjee
This should be pretty simple as well because mobile was written and black was written there we have got the buttons okay what about this
Anshuman Chatterjee
Icon it is showing broadband but we know this icon more as a data card so let's try click on data card
Anshuman Chatterjee
What happens now it's my CI ancient powerful enough to present I said this is a data cart yes it recognizes that it the label
Anshuman Chatterjee
Of this image is broadband but this image looks more like a data card so good computer very good computer
Anshuman Chatterjee
Again click on back let's now try to type some text type
Anshuman Chatterjee
Pcloudy on the search text box this is how am I not just old right correct let's see whether my engine is efficient enough
Anshuman Chatterjee
Correct yeah it knows how it how it's done okay now let's try to click on menu
Anshuman Chatterjee
So here menu is nowhere written it is also known as hamburger I turn or the burger I can so let see if my AI
Anshuman Chatterjee
Engine recognizes what is the purpose of this menu button
Anshuman Chatterjee
Yeah it has highlighted okay now let's click on home again
Anshuman Chatterjee
Again the home was played now I want to show you some more key words so I'll just try to click on
Anshuman Chatterjee
View all offers so whatever I am typing this you can also save in a dot txt file by using your notepad so your manual
Anshuman Chatterjee
Tester can create a test strip like this and pass it to the program so that it gets executed one by one and you don't
Anshuman Chatterjee
Have to give you inputs one after the another and
Anshuman Chatterjee
This way your manual tester is able to perform automation of 70% of your test cases without knowing whatever is getting changed whatever are the
Anshuman Chatterjee
Object properties what is getting changed and whether the layout has been updated are there more layers to this application maybe the IDs or the
Anshuman Chatterjee
Xbox have changed you don't have to worry about it so now let us try a slight thing so I can I cannot see whatever
Anshuman Chatterjee
Is down so as a manual it has to be right
Anshuman Chatterjee
Slide to midnight sale so here as per my requirement document I there have to be an offer like midnight sale but I don't see
Anshuman Chatterjee
It over here so I'll say swipe to midnight sale and let me see yeah it's rikes here you can see the midnight sale is
Anshuman Chatterjee
There now suppose I want to click on this image I don't know the ID I don't know the XPath so because I'm a manual
Anshuman Chatterjee
Tester right I don't knows all those techy things and there is a good chance that I don't have
Anshuman Chatterjee
Access to the application when I'm creating the test cases as well maybe I am just performing test development in my organization and I am
Anshuman Chatterjee
Just writing the test cases so let me try click on
Anshuman Chatterjee
Wow using maybe OCR because this is not a generic image so let us see whether my engine is able to click on the valve
Anshuman Chatterjee
Sale over here yeah it clicked right so I think
Anshuman Chatterjee
This is okay so this was all on an iPhone device I'll just release this device and
Anshuman Chatterjee
We can see that on the iPhone device our AI engine so it is the same engine that we show giving the feedbacks to that's
Anshuman Chatterjee
The same engine running on another server on a Intel no server we have running it now and it will ran correct so guys if
Anshuman Chatterjee
You have any questions feel free to throw them to towards me by using this questions tab and
Anshuman Chatterjee
Next I'll also show you a similar demo on and bright
Anshuman Chatterjee
So because whatever we have created the AI server it doesn't knows whether it is an Apple phone it is an Android phone or maybe
Anshuman Chatterjee
It is an web application what is it knows that yes this is a data card I can this is a telephone icon this is
Anshuman Chatterjee
A menu item and it knows how to do OCR's it knows what are the test cases it knows how to and life a test
Anshuman Chatterjee
Case it knows how to check okay this is your action this is your keyword so all types of NLP and those things are built
Anshuman Chatterjee
Into it so you don't need to worry about that is an Android or that is an iOS so here I have one
Anshuman Chatterjee
Leno device as well with me so I will connect onto that
Anshuman Chatterjee
And again I'll open up my program okay so I see a similar kind of look and feel in the iOS as well as the
Anshuman Chatterjee
Android device so this is a Lenovo k-6 power device so the application has a similar look and feel so ideally my stimulus test case
Anshuman Chatterjee
Should work on both Android and iOS given that the look and fees are the same so okay let me try to the same with
Anshuman Chatterjee
The same thing click on Oh buddy yep so the same input click on mobile that works on iOS as well as on Android because
Anshuman Chatterjee
The look and feel of my application is the same
Anshuman Chatterjee
Now let me click on back ok so it has clicked on back what if I say ok tap on globe
Anshuman Chatterjee
Not global tap on globe so the creator of this application has chosen to give the label Internet to this globe icon but as a
Anshuman Chatterjee
Manual tester I will call it globe tap on globe so now my engine should be interesting enough to differentiate between what is internet and
Anshuman Chatterjee
What is globe yeah this was the globe icon click on back maybe so here you can see how seamlessly you can create your test
Anshuman Chatterjee
Cases and the a so what should be able to cover up 70% of your test cases which doesn't need much of the complexity involved
Anshuman Chatterjee
In mobile application testing and you get rid of your object identifications the X fast the IDS and the fear of applications getting upgraded due
Anshuman Chatterjee
To which your test case we'll start fading because a manual tester will always say okay this some is still working but as an automation
Anshuman Chatterjee
Tester you will say array the IDS got updated or the XPath got updated that's why if my tests have started breaking so let's just
Anshuman Chatterjee
Try with a typed X again instead of Pcloudy let me say and Sherman on this
Anshuman Chatterjee
Search text box does this works yeah the tactics also works now let us say like click on
Anshuman Chatterjee
View all suppose yeah this an interesting factors well suppose what this case was created when instead of view all offers this button was view
Anshuman Chatterjee
All okay so now suppose this application has been updated but my test case remains and there is only a single we wall button which
Anshuman Chatterjee
Has renamed to you all offer so it will give the priority intelligent Li to this button to let us check if we wall works
Anshuman Chatterjee
Yeah it works so now let's say go back and right go back so should able to make the hard key of the Android device
Anshuman Chatterjee
So here this what I am covered up with this device demo on device and I'll release this device quickly and we'll come back to
Anshuman Chatterjee
PPT so Showtime is now almost over so now I want you to hit me with the that you have so this was a small
Anshuman Chatterjee
Teaser of what we are trying to achieve in this forum through our Pcloudy devices and guys I'll give you
Anshuman Chatterjee
Some moment to think and type your questions and we'll try to answer as much as possible for any questions that we cannot attend in
Anshuman Chatterjee
This session so we will try to come back as soon as possible
Anshuman Chatterjee
When you write the commands where did you write the commands did you have a bit better I get about or under code
Anshuman Chatterjee
Okay so where did you write the commands is from annal so I was writing the commands in a terminal which was again a Java
Anshuman Chatterjee
Program I was giving it through the input screen so instead of writing the commands in the terminal you can create a text file as
Anshuman Chatterjee
I've already mentioned and you can get that in your you can save it as a as a test case file in the dot txt
Anshuman Chatterjee
Format and then you can give it as an input argument to the to my java program so that it gets executed so the Java
Anshuman Chatterjee
Program is just the 5% of what we are doing here the main part is the backend where the AI server is running so it
Anshuman Chatterjee
Has got all the logics of getting your little piece done to get ting your OCR
Anshuman Chatterjee
Done and recognizing whatever icons are there it has got a large while icons repositories
Anshuman Chatterjee
So do you have any bitbucket or git repo for run codon local so this from Roshan so Roshan we have our code hosted in
Anshuman Chatterjee
The gate repository but it is currently in a private repo so it is not accessible to sublease but yeah if you are interested me
Anshuman Chatterjee
Then we can surely have another demand so ugly I can give you an Alfa built in maybe a couple of days
Anshuman Chatterjee
What else are you writing the manual steps in IDE if so what idea is suppose do we need to write associated metals for my
Anshuman Chatterjee
Application okay so again this is a question from Ravi so there is a similar question that we don't need an ID it was it
Anshuman Chatterjee
Can all be a simple notepad fine wear a simple text file so you can input the
Anshuman Chatterjee
Test case in one liner so everything is a command which is getting processed by the server in the backend so either you can have
Anshuman Chatterjee
Some rest queries rest api you can send it like a post or maybe you can give it as a file or you can have
Anshuman Chatterjee
It in the interactive mode as we have just seen so whatever ID you want to use maybe it is in Python or maybe says
Anshuman Chatterjee
In.net or maybe Java so whatever that thing is that you are saying ID that it's just the 5% of it you don't need anything
Anshuman Chatterjee
Over there you just need a small connectors and everything goes back to your server to get processed and that a service responsible for performing
Anshuman Chatterjee
Your actions thanks Ruiz thanks for your questions so how do you get the data of the apps so that's an qts and diligent questions
Anshuman Chatterjee
So so we have close to ten thousands of applications from the Google and Apple stores and there are some other programs that run twenty
Anshuman Chatterjee
Four to seven on those applications which install the applications on our device cloud try to get the details of the application objects and the
Anshuman Chatterjee
Object images and then we have created a repository where we have close to 50 lakhs of icons as of now and
Anshuman Chatterjee
We have that repository and we use that repository daily to train our a a model and it is getting better day by day and
Anshuman Chatterjee
We also have we have some plans to host some of the part as an application very users can submit icons and they can get
Anshuman Chatterjee
Rewarded in some forms so how can I pitch this to client okay so well
Anshuman Chatterjee
This might be a tough question for me because I'm a code techie guy but
Anshuman Chatterjee
Let me think how do you pitch this to the client first
Anshuman Chatterjee
You have to ask your client what is his problem is he able to write a single test case on
Anshuman Chatterjee
Android and iOS or even if he is facing some challenges is he if he is
Anshuman Chatterjee
Following the TDD frameworks system and developments and before even that is your client or the application it is ready for a or do you
Anshuman Chatterjee
Even need this a thing to do you even want your manual testers to write your test cases if some of the answers to the
Anshuman Chatterjee
Off question is yes then I think you can pitch this to the client
Anshuman Chatterjee
Okay now I'm getting some of the technical questions can same instructions we use in other platforms on similar applications other than Android and iOS
Anshuman Chatterjee
That's correct that was from the tip okay are you using neural networks yes we are using convolutional neural networks that is but all in
Anshuman Chatterjee
The back end that is already taken care of okay do you support multi devices script for same test script yeah you can fill out
Anshuman Chatterjee
A suppose execution on multiple devices so that's a yes
Anshuman Chatterjee
Is a logic independent of platform like I can integrate it with Java and c-sharp yeah Gaurav I have answered that question already yes you
Anshuman Chatterjee
Can that the a logic is independent of platform that's all call based so
Anshuman Chatterjee
You can ask over a iced-over of what the icons are what the images are whether it can perform an OCR oh you can ask
Anshuman Chatterjee
Away ice over where the object in the current page lies so my ax over can tell you okay it relies on this much coordinate
Anshuman Chatterjee
And beside this much object comes any known alternative that can be implemented in c-sharp instead of Java yeah so the Java part is just
Anshuman Chatterjee
The 5% of it we can rewrite it in sisha or any other language it's all the KPA calls
Anshuman Chatterjee
Okay so an interesting question from Nikhil so AI is associated with large amount of data I did not see this in the show time
Anshuman Chatterjee
So nickel I told I told this a few minutes earlier that here you need lost and loss of data and whatever
Anshuman Chatterjee
We have shown you but in today's teaser that was all done in a prebuilt model so my executions for training the model is going
Anshuman Chatterjee
On and that's like a huge database and we have spent some good amount of time collecting the data over the past few months now
Anshuman Chatterjee
And we are still collecting it okay for to start training a score of this model so currently it's around ninety four point eight six
Anshuman Chatterjee
Percent and what we are trying to achieve it's at least above ninety seven percent so whatever I have learnt us anything about above ninety
Anshuman Chatterjee
Five percent is a good enough data and good enough percentage and
Anshuman Chatterjee
It was probably we will be improving our model over the the next few weeks with more and more data coming from probably you guys
Anshuman Chatterjee
If you are willing to help and willing to contribute okay so another question from shares so if we write hundred number of test cases
Anshuman Chatterjee
In a notepad does it execute one by one with no human health so shares that is an ideal situation where you write hundreds of
Anshuman Chatterjee
Test cases and with no human health my model excuse all of your test cases execute one by one but at some point of time
Anshuman Chatterjee
The AI model as I said in the demo it's the baby it's learn as much as you teach it as much as you feed
Anshuman Chatterjee
It so you have to give some sort of feedbacks so whenever my model saves know whenever my model commits a mistake you have to
Anshuman Chatterjee
Say remember i said 'no bad bad computer you have to say that in an API and i promise the next time when you execute
Anshuman Chatterjee
Your test cases the model should behave in a better way so
Anshuman Chatterjee
Yes once we achieve that maturity that my model is like 99% accurate then probably out of 400 test cases 99 test cases will run
Anshuman Chatterjee
But as of now you before starting you might need some of the training data maybe your applications or the äôt that you are talking
Anshuman Chatterjee
About that is some domain-specific and we don't have the labels for the that particular domains so probably first in the first three to four
Anshuman Chatterjee
Days we need to run a program where the spraining will occur and you will need some human help maybe you or someone from your
Anshuman Chatterjee
Organization or maybe if you can pass that in for that application to us so maybe we can train our models once the training happens
Anshuman Chatterjee
Then my model will ensue and it will start accepting the labels that you use your in your applications the images the OCR that you
Anshuman Chatterjee
Use in your application it should be able to improvise
Anshuman Chatterjee
How much programming knowledge is needed for a tester to do model training and predictions so
Anshuman Chatterjee
You don't need any programming knowledge as I have shown it's all text-based test cases so badly you don't need any programming knowledge to execute
Anshuman Chatterjee
Test case however for the model training and prediction that is what we take care of so if you want if you want to a
Anshuman Chatterjee
Build your own model you can have it but it requires a good level of programming and
Anshuman Chatterjee
Preferably on Python instead of java.net so if you want to have your own model so we have created our models in Titan and that's
Anshuman Chatterjee
All running in micro-services smoke in a separate servers so
Anshuman Chatterjee
Is there any other source of data set you used yes we first we started by getting the data set from a couple of data
Anshuman Chatterjee
Sets from kaggle that already has some of the data hosted and early days the tester ki data health as well but it was all
Anshuman Chatterjee
Like monotone colored and then the evolve and we created our own data sets we will be we have plans to publish that in kaggle
Anshuman Chatterjee
As well so you guys have we see only a few minutes left for the webinar
Anshuman Chatterjee
Questions okay how does this usin automations ok so we often found that some objects have no descriptive properties such as text or ID but
Anshuman Chatterjee
User knows that what type of object is it so manifesto we in our day-to-day life we know okay this is the hamburger icon there's
Anshuman Chatterjee
A menu icon there's a back button this is a left arrow then you have to cite the words right we all know these types
Anshuman Chatterjee
Of terms but seeing an application we don't know what is the expert or is the ID what is the taste maybe that is not
Anshuman Chatterjee
Available so this is how the AI portion works with your maybe in your existing automation or as a standalone one so guys again I
Anshuman Chatterjee
Want to reiterate that this AI technology this will not eradicate the need of testing and this will not cover a hundred percent of your
Anshuman Chatterjee
Test cases wherever you will be having complex test cases maybe take some data from something and validate the OT piece all those things probably
Anshuman Chatterjee
You will still need other automation frameworks but yeah the AI is evolving the AI world is evolving and so are we so probably in
Anshuman Chatterjee
The next couple of quarters you can be more dependent on a like I said in the PPT first so seven minutes of manual aircraft
Anshuman Chatterjee
Flying and then AI takes over so that seven minutes still needs to be done but then they I can take a work is the
Anshuman Chatterjee
Pcloudy model chargeable what are the features and pricing can you share the links so nickel I don't have an answer for that yet
Anshuman Chatterjee
But if you are talking about the Pcloudy clouds so you can sign up and get around hundred minutes of free usage and you
Anshuman Chatterjee
Can try out the platform but if you are trying if you are saying about this a a model so we are still in the
Anshuman Chatterjee
As firm face so we are giving this to some of the clients some of the known fly so that it is run under a
Anshuman Chatterjee
Controlled environment and probably once this bottle gets more mature I can come up with with the features and more pricing information that you have
Anshuman Chatterjee
Asked for so is it possible to test one test case there need to use two application
Anshuman Chatterjee
So okay if they're Russian I correct me if I'm wrong so I assume that you are saying that you have a single test case
Anshuman Chatterjee
But you have two different applications and the single test case is valid for both the applications and you want to in the single test
Anshuman Chatterjee
Case you want to move between your applications so perform a few steps on application one and perform the rest of the steps on application
Anshuman Chatterjee
To correct me if I'm wrong if this is your scenario then yes that is possible because the AI server doesn't even knows that whether
Anshuman Chatterjee
You are running it on an iOS application or on an Android application or runnin web platform
Anshuman Chatterjee
So the answer to you buddy yes yes yeah for example in your question like the Amazon and Flipkart they might have a similar kind
Anshuman Chatterjee
Of functionality or maybe the signups that we are seeing through social networking maybe the Facebook sign of the Google sign up they all may
Anshuman Chatterjee
Be simple they all have the same functionality so yes your single test case should work on both the application and probably if you are
Anshuman Chatterjee
Asking about creating a model like choose some random applicants and them products and add it to the cart so yes amazon has a cart
Anshuman Chatterjee
A shopping cart and Flipkart is a no shopping cart so yes it's possible
Anshuman Chatterjee
Guys we have some of the questions left that I would be probably sharing you later on
Anshuman Chatterjee
Let me take a last question so I'll try to answer one of the most technical questions that I'm seeing over here let me just
Anshuman Chatterjee
Quickly go through all of your queries and I'll just check it out
Anshuman Chatterjee
Okay I cannot answer this question to the fullest but yes we are using Python and our model is based on Google's tensor flow and
Anshuman Chatterjee
That is like Inception v3 model for the image recognition and for the OCR think we are still using Google
Anshuman Chatterjee
Google vision so guys thank you for your time I think
Anshuman Chatterjee
We are now on the edge and rest of the questions are Lindy and I'll have to come up
Anshuman Chatterjee
Ok the last one from Russian can you please guide me about my application security that I'm testing on your device so Russian that is
Anshuman Chatterjee
A different dimension altogether that has the things do with the current AI approach of testing that has says although we in the inner same
Anshuman Chatterjee
Organization of one another team is already working on a predictive testing which contains some security things that you might be interested on so probably
Anshuman Chatterjee
I will I can share you a PPT for that that was a webinar
Anshuman Chatterjee
Avinash gave you month back probably you will be benefited by that PPT and by that webinar and you can probably find it on YouTube
Anshuman Chatterjee
Or else I'll share that with you so thank you everyone thanks for your time and thank you for attending
Anshuman Chatterjee
If you want if you love it if you want to see more of it you can
Anshuman Chatterjee
Send us your comments or your suggestions and your life we love it thank you
