Avinash Tiwari
Hey uh good afternoon everyone uh we're all set to start
Avinash Tiwari
Some of you are still joining in um we'll just wait for maybe one more
Avinash Tiwari
Minute great in the meantime some housekeeping rules so this webinar will be close to 35 to 40 minutes in duration uh post that we
Avinash Tiwari
Can take up any questions and answers and for question and answer you can see an icon in your
Avinash Tiwari
Webinar view you can post your questions and we will be able to take take that up during the end of the webinar
Avinash Tiwari
We wanted to do this webinar in a much more fun and interesting way
Avinash Tiwari
So if you can open up your phones and scan this qr code or on your desktop just open this url which you see on
Avinash Tiwari
This slide aha slides.com the code which is mentioned here or easier way to do is to just scan the qr code
Avinash Tiwari
Great uh we will show this qr code again during the uh webinar if people who who who have not done it or people who
Avinash Tiwari
Will join a bit late can do it again so in the interest of time and for people who have joined uh we will get
Avinash Tiwari
Started uh good afternoon everyone thank you so much for uh finding time for this webinar
Avinash Tiwari
So each year at Pcloudy we publish a and last year 2020 the report that we published was a huge success uh in fact
Avinash Tiwari
We published two reports and both were hugely elected within the industry and uh that encouraged much more detail this webinar will give you a
Avinash Tiwari
Gist of what uh the trends that we see in the industry uh before we talk about the trend let me uh give you uh
Avinash Tiwari
A bit of introduction about myself so my name is avinash tiwari i am co-founder of smart software testing solutions
Avinash Tiwari
And our flagship product Pcloudy serves more than 150k users globally
Avinash Tiwari
Five years back i was working with a prospective customer from boston u.s let's name him brian for this discussion
Avinash Tiwari
So brian was the digital head of a large insurance company with teams across the globe in countries like mexico india and japan
Avinash Tiwari
And during one of the calls when i was trying to understand his pain points he mentioned that it's a winter storm in boston
Avinash Tiwari
And the roads are all snow filled and no one can go to office
Avinash Tiwari
So all his developers and testers are working from home
Avinash Tiwari
This is five years back and he was frustrated with the efficiency loss for his app dev and test teams because his device test lab
Avinash Tiwari
Was not accessible remotely he wanted remote access of the lab immediately for all his teams not only the teams which are in boston but
Avinash Tiwari
The teams which were located across the globe and his eventual vision was to replace manual testing effort by enabling continuous automation runs as part
Avinash Tiwari
Of the devops implementation i was fortunate enough to work with him
Avinash Tiwari
And after a few years he made a statement during one of the feedback calls
Avinash Tiwari
And the the statement was that today sun never sets on my qa
Avinash Tiwari
There could have been a better testimony from a customer apart from the numbers that you can talk about in terms of rois in terms
Avinash Tiwari
Of efforts say but the statement that now sun never sets on my qa i am able to operate 24x7 seamlessly across all the teams
Avinash Tiwari
Which are geographically located was a big testimony for us as a product
Avinash Tiwari
And in this journey Pcloudy played a big role uh in this transition for the customer
Avinash Tiwari
So this was possible because uh the customer brian in this case uh could foresee the trends early on
Avinash Tiwari
And looked for right tools and platforms so our objective always has been to come up with these trends to give you more insights in
Avinash Tiwari
A much more concise and crisp way so that you can take those insights and start implementing it and be an early adopter like in
Avinash Tiwari
Our case brian was clearly an early adopter he saw the need of remote testing five years back and now as part of pandemic we
Avinash Tiwari
Are seeing uh need of remote testing almost everywhere so be an early adopter and uh use the trends to benefit uh individually as well
Avinash Tiwari
As make sure that your organization benefits from it so that's the whole objective of bringing these kind of reports and that's the philosophy we
Avinash Tiwari
Have followed as part of our product development as well to align our product roadmap with the trends that we see which are coming from
Avinash Tiwari
Directly from the industry to give you a sense of how we did this report we talked to almost 100 of our customers more than
Avinash Tiwari
100 customers and collected a lot of data around what are the pain points what are the techniques that they are using and based on
Avinash Tiwari
That we have generate generated this report so it's not something which is completely coming from someone's thought it is validated data coming from the
Avinash Tiwari
Industry you can call it voice of the industry so with this uh let's see what it what is there inside the report and before
Avinash Tiwari
We do that uh what we have seen i mean in last five years uh while working with while developing Pcloudy as a product we
Avinash Tiwari
Saw two key areas i mean first from the side of the users
Avinash Tiwari
And we always see that users are only worried about the quality right when it especially when it comes to the applications uh mobile or
Avinash Tiwari
Web applications their main concern is the quality and experience of the product or the service that you're releasing and from the business side of
Avinash Tiwari
It now in the current situation it's all about speed how do i reach out to the customer in a faster way how do i
Avinash Tiwari
Reach out to the customer faster than my competition so it's this intersection between quality and speed uh is what makes any organization successful
Avinash Tiwari
And that is where we operated so when we talk about quality from the the user point of view it's all about holistic view of
Avinash Tiwari
The quality uh in in case of especially applications it's all about having a seamless view across different interfaces like mobile desktops nowadays variables smart
Avinash Tiwari
Devices the the consumer experience the seamless experience is extremely key and when it comes to the the business side of it the speed how
Avinash Tiwari
Do we reduce the human effort how do we scale up the automation how do we finish the testing faster than ever so these are
Avinash Tiwari
The challenges of the problem statement that comes into play so this intersection between quality and speed is what we operate in and that is
Avinash Tiwari
Where Pcloudy comes into play to enable you to achieve quality and speed right so in a nutshell to talk about what is p
Avinash Tiwari
Cloudy so uh sorry for the interruption here uh so talk about talk a little bit about what Pcloudy is a product is some of
Avinash Tiwari
You might be aware already but some of you who are new to Pcloudy uh we are a continuous testing platform uh which enables
Avinash Tiwari
Organizations to achieve quality at speed right and we do it in a way where we enable organizations to create remote testing infrastructure in terms
Avinash Tiwari
Of device and browser labs we enable organizations to achieve rapid automation and then use this automation at scale when you execute it backed by
Avinash Tiwari
Solid test analytics and devops plugins you can achieve your continuous testing goals and and be part of your devops journey so that's what p
Avinash Tiwari
Cloudy as a product is we we have had a great journey in last five years uh we have more than uh 150k users across
Avinash Tiwari
The globe uh 500 plus companies are already using our product out of which more than 30 plus our fortune 500 clients and we have
Avinash Tiwari
Been recognized by analysts from gartner's forester and also has a very high rating on platforms like g2 crowd which is an independent review platform
Avinash Tiwari
We work with companies across the board you can see different names across variety of industries like media telecom insurance e-commerce and some of the
Avinash Tiwari
Names are very very recognizable so we work with startups to big enterprises
Avinash Tiwari
And help help them in their app testing journeys so with this background
Avinash Tiwari
About Pcloudy uh let's just quickly understand uh about you as well that who are you so that's what i said if you have
Avinash Tiwari
Uh scan the qr code if you have not i'll just show the qr code again so that you can do it now if you
Avinash Tiwari
Haven't uh please do it because it'll be much more fun uh you'd like to understand your view along uh the way we are along
Avinash Tiwari
The way when we are presenting the data you can also validate your thoughts before you see the data so i would encourage all of
Avinash Tiwari
You to just quickly scan and be part of this
Avinash Tiwari
Discussion so we'll just wait for uh a few seconds more before we
Avinash Tiwari
Jump into the next slide okay hope you have done that uh
Avinash Tiwari
And if that's the case we will move to the main
Avinash Tiwari
Agenda okay i'm sorry so the first question was where are you from so i can see people uh saying bangalore chennai noida there are
Avinash Tiwari
People from london spain delhi good to see a global audience here we as i said we have customers from across the globe um
Avinash Tiwari
Great uh great to see this word cloud coming up the majority of you seems to be from india bangalore great to see
Avinash Tiwari
Great that gives us a good sense of where the where are you located the next question is what role do you play
Avinash Tiwari
Great we already have answers here so close to 15 percent are
Avinash Tiwari
Leaders then we have yeah good number of people from the
Avinash Tiwari
Management layer an equally good number of people from the specialized areas the experts
Avinash Tiwari
Awesome so this again gives us a good sense of the breakup
Avinash Tiwari
And if you can just quickly uh point out which industry what industry are you from i.t healthcare fintech just what is your industry that
Avinash Tiwari
You're working okay automobile i.t fintech okay i.t information technology come on go ahead just do it as quickly as possible
Avinash Tiwari
Health trek palmer great so again uh we we can see the variety of the audience here that makes it much more
Avinash Tiwari
Worthy of the discussion as i said in the beginning our customers are across various domains so that also reflects the diversity here great
Avinash Tiwari
So now that we know you uh just a quick uh sense of how many of you are already working on apps uh is app
Avinash Tiwari
Part of your regular development or testing or you are from some other area
Avinash Tiwari
It looks like most of you are from [Music] the app
Avinash Tiwari
Teams awesome awesome 100 so good to see this great so keep the qr code on you will get many more questions along the way
Avinash Tiwari
And you'll be able to validate some of the thoughts that you have in mind and what you see the trend from the industry great
Avinash Tiwari
So let's begin when uh the pandemic started almost it's been almost a year
Avinash Tiwari
We all switched to uh the the world of digital uh very very quickly though digital has been uh there in the as a buzzword
Avinash Tiwari
From quite some time but it got a big push during the pandemic and the the new normal that we see is more and more
Avinash Tiwari
Usage of the apps across various industries so you can look at this data every industry beat streaming to shopping to business education so a
Avinash Tiwari
Big jump in the usage of the app so as as i mean all of you are part of the app teams we all can
Avinash Tiwari
Be very proud of the fact that app industry is going to grow and usage of apps across various industries is going to be the
Avinash Tiwari
New normal so it brings all the more responsibility on all of us to make sure that the experience of the app the the features
Avinash Tiwari
Which the customers require reach faster than ever again similar data that the time spent on the business app specif specifically uh has increased dramatically
Avinash Tiwari
The time spent has grown by 275 percent at the end of 2020
Avinash Tiwari
And you can see a very steep rise and again you can link it to the pandemic and the way situation change everywhere you don't
Avinash Tiwari
Have any other option but to choose the digital side of the the business and app becomes the forefront when we talk about the digital
Avinash Tiwari
Side so again uh that's the new normal that we are seeing
Avinash Tiwari
And lastly uh one good trend that we saw across the industry was the use usage of hybrid apps there's a lot of debate around
Avinash Tiwari
Which is more popular native hybrid now progressive web is coming up but still across the industries the usage of hybrid app has been more
Avinash Tiwari
Than any other category so that again is a good data point for us in terms of what kind of apps would we see from
Avinash Tiwari
The testing perspective which will come our way so that's a data point that you can take up and and plan your future testing strategies
Avinash Tiwari
Or future development strategies now uh let's get on to the the real trend uh that you're talking about uh just before that one more
Avinash Tiwari
Question if you can just go to your phone or on your tab where you have scanned it when would you not use an app
Avinash Tiwari
Or give it a bad rating what are the reasons because of which you will give a bad rating of the app just just type
Avinash Tiwari
And let's see what comes out crash okay great is that the main reason low response time awesome ui lag ui not great awesome
Avinash Tiwari
Performance yeah a lot of it is common performance lag low response time uh crash interface user friendly great i think uh we all are
Avinash Tiwari
In sync as far as these issues are concerned a similar question on the same lines
Avinash Tiwari
Okay i think we are already done with that question so what we saw in the industry uh is very similar to what we saw
Avinash Tiwari
As a result uh from your answers uh what the biggest reason of uninstalling of apps is app crashes 71 percent of the times the
Avinash Tiwari
The crash leads to uninstalling of apps uh from the the user's machine
Avinash Tiwari
And uh the reason of abandoning of apps the excessive load time or the low response time that you all talked about almost 70 percent
Avinash Tiwari
Uh says that that's the main reason and uh we have talked at length in various other webinars or there are papers that were published
Avinash Tiwari
As to why app crashes happen especially for the apps why is it is so important to test your apps across variety of devices and
Avinash Tiwari
How do you really choose the right set of devices i'm not going to talk about that right now you can always go if you
Avinash Tiwari
Go to our blogs or if you're following our linkedin pages
Avinash Tiwari
You you would have seen those kind of articles if not go to our blog pages and see those articles you can search for why
Avinash Tiwari
App crashes and you will find a very scientific way of finding out which devices should we choose so that we can minimize the app
Avinash Tiwari
Crashes so that's the big reason and we are as per your responses we the industries also feels the same way
Avinash Tiwari
Now as for the trend agenda is concerned there are uh areas that we are going to focus on so again this question uh how
Avinash Tiwari
Can you speed up your release cycle any thoughts so is it that you will do automation what are the ways that you speed up
Avinash Tiwari
Your release cycle we talked about quality and speed so automation is one area faster testing
Avinash Tiwari
Automation automation is something which many of you are repeating network security
Avinash Tiwari
Okay speed with network security that's a interesting one early testing adopt devops continuous testing
Avinash Tiwari
Awesome i think it gives us a sense of what your thoughts are shift left continuous test simultaneous process on both dev and test yeah
Avinash Tiwari
Continuous test is one big area that that comes out of it good what we see uh from our survey uh what industry is doing
Avinash Tiwari
Uh especially after the pandemic right last one year this is the data which
Avinash Tiwari
You can relate it to the last one year work of the organizations so over 60 of the organization are implementing continuous testing methodology vigorously
Avinash Tiwari
To scale up their testing strategy right so and if you kind of
Avinash Tiwari
See the further data that we are going to talk about uh that validates the thought further but what we are seeing is an increasing
Avinash Tiwari
Trend in terms of adoption of continuous testing and again we have done many more webinars on continuous testing specifically how to implement and how
Avinash Tiwari
To do it in a much more holistic way but one thing i want to make it very clear right now is a lot of
Avinash Tiwari
Times continuous testing uh people perceive it as okay i'll run my automation scripts with some ci tool that that brings uh or that implements
Avinash Tiwari
The continuous testing for me that's a complete myth continuous testing is a very holistic view of how do we automate testing at each stage
Avinash Tiwari
Beat your deployment to your unit testing to your regression as well as your production monitoring so it's a complete gamut of the automation that
Avinash Tiwari
You have to look at and you have to automate at various places to achieve continuous testing so what we are seeing is increasing trend
Avinash Tiwari
Uh we still are quite far in terms of 100 of organizations implementing continuous testing and as i said a complete holistic view of continuous
Avinash Tiwari
Testing is still missing in a lot of places so people have started adopting to control switching early but yeah they they have long way
Avinash Tiwari
To go and the data that we see next uh supports that fact that one of the key pillars of continuous testing is your automation
Avinash Tiwari
Coverage now what we see here is still uh uh 52 of organizations are having 60 or less automation uh only 22 percent are having
Avinash Tiwari
Automation in the range of 8200 and that's where we all have to be if we are looking at continuous testing we all have to
Avinash Tiwari
Be there in that 8 200 category and there are various ways to increase or enhance the coverage of the automation it need not be
Avinash Tiwari
Just functional way of automation only there are a lot of strategies in terms of functional api your unit tests as i said production monitoring
Avinash Tiwari
Automation so it's a complete kind of gamut of things that you will have to do to make sure that you you reach that stage
Avinash Tiwari
Um so organizations even though they have started implementing continuous testing automation coverage is low which is a concern and uh we we definitely see
Avinash Tiwari
That organizations are putting more focus on the in the coverage but uh until unless we reach that category of 8200 continuous testing will not
Avinash Tiwari
Be uh complete and you will start failing another data point uh which is very uh important for continuous testing implementation is test environment orchestration
Avinash Tiwari
Now along with automation until unless you have automated your test environment creation you still cannot achieve continuous testing right so that's very very critical
Avinash Tiwari
Uh in terms of uh your ci cd deployment itself so
Avinash Tiwari
We see that almost 60 of organizations are already using it using which is a very encouraging sign but still almost 40 percent are somewhere
Avinash Tiwari
There um but if you have to again uh achieve continuous testing test orchestration is one of the key pillars
Avinash Tiwari
So automating the test environment of provisioning through either dockers or any other techniques that you can use to automate is something very much required
Avinash Tiwari
And again we have a lot of further material that you can read how do we do the test environment orchestration
Avinash Tiwari
But for the time being uh this data point will give you a sense of where you are and where the industry is and where
Avinash Tiwari
You are which guy which category you fall in so so the this is the trend one one definitely we see that the continuous testing
Avinash Tiwari
Is on the rise but there are certain concerns in terms of the low automation coverage and also uh still the test environment orchestration is
Avinash Tiwari
Not um have not reached or near 200 so these two areas most of the organizations have to work on and a data point for
Avinash Tiwari
All of you so adopting continuous testing is going to be vital part of this strategy to speed up the app release that's the message
Avinash Tiwari
From the trend one now we'll move to the next part of it and again you can go back to your uh phones or your
Avinash Tiwari
Tabs and answer that question how dependent are you on the tools for tools for work so is it like you can you you are
Avinash Tiwari
Completely 100 dependent or some part of it is still manual some part of it
Avinash Tiwari
You you can do it without the tools what's the status
Avinash Tiwari
Go ahead just based on your experience just answer it
Avinash Tiwari
Okay so 25 percent of you are saying that i can complete a significant amount of work without any tools that's quite surprising
Avinash Tiwari
Eleven percent uh say i cannot work if any of my tools fail and 50 is almost 55 i can complete some amount of work
Avinash Tiwari
Without any goals so this figure is quite surprising that you can still complete significant amount of work without any tools that's a very risky
Avinash Tiwari
Territory considering the current situation we are in the dependency on the tools is very high and one of the reasons we were able to
Avinash Tiwari
As an organization i can tell you our experience one of the reasons why we were able to switch to a complete remote work environment
Avinash Tiwari
Once the pandemic hit within few days because we were using most of the tools on cloud uh we we had hardly uh we were
Avinash Tiwari
Hardly using any physical infrastructure in our offices and all so we could just switch to remote working within few days um and that's the
Avinash Tiwari
Kind of agility you need within an organization going forward considering the dynamic nature of the work environment or the business environment that we see
Avinash Tiwari
In so this 36 is a bit of a risky zone uh let's see what the industry says uh before that uh the question
Avinash Tiwari
So are you able to access those tools remotely so whichever tools are using are you able to access it remotely or all these are
Avinash Tiwari
Still physical okay so again the percentage it's quite balanced it's quite mixed
Avinash Tiwari
It's almost 50 50. that's awesome cool so let's see what the industry has to say about it uh when we ask the customers what
Avinash Tiwari
Is the current situation and how pandemic impacted their usage of the the tools um
Avinash Tiwari
Almost uh 15 and and that that was the kind of percentage we saw in the survey also that uh 15 were totally dependent on
Avinash Tiwari
The tools and again those tools are completely on sas which means they have adopted the cloud in a com in a complete way 60
Avinash Tiwari
Saw of significant shift on cloud uh as far as their tools are concerned uh 26 moderate and uh 3 no shift
Avinash Tiwari
So that's that's that's why i was saying that uh if uh in the responses that we saw if 30 percent of you or 35
Avinash Tiwari
Of you were saying that i can still work without two that's a bit of risky territory because industry is moving towards um a stage
Avinash Tiwari
Where you have to use cloud-based tool it could be internal cloud it could be external cloud that depends on the organizational situation the kind
Avinash Tiwari
Of security policies and regulatory environment that you have but it needs to be accessed remotely in a cloud environment that's the key message here
Avinash Tiwari
And you can see the the data point and ah relate to it
Avinash Tiwari
So what this means for us as i said uh i don't want to repeat here that as the industry is moving and the dynamic
Avinash Tiwari
Work situation that we see uh the cloud is the key uh or cloud is the game um as i said it could be internal
Avinash Tiwari
Or external cloud but you need to start thinking about moving your tools on the cloud as quickly as possible i mean we saw many
Avinash Tiwari
Of the uh in fact most secured uh customers pharma or even banks uh started using the public cloud that we have i mean earlier
Avinash Tiwari
They they were so uh rigid about not looking at public cloud at all but now they have adopted to the public cloud so there
Avinash Tiwari
Is a lot of shift that we are seeing in terms of the the mindset in terms of adoption of the cloud within even the most
Avinash Tiwari
Regulated and the most secured environments so you need to start looking at that
Avinash Tiwari
Okay uh next question uh so second trend was about the usage of the cloud across different tools
Avinash Tiwari
Third trend we will look at what what the third trend is uh what are the some of the technology that you use in organization
Avinash Tiwari
To reduce human intervention we talked about speed as one of the key driving factor for businesses so how do you achieve speed uh is
Avinash Tiwari
It automation how do you reduce human intervention what are the new ways that you're trying automation tools create
Avinash Tiwari
Automation yeah any other area that you see coming up rpa great load testing tools awesome
Avinash Tiwari
Devops okay scriptless platforms okay aws automation tools okay no code platforms
Avinash Tiwari
Okay okay let's see what we saw so i agree when some of uh most of it is right automation is the key right when
Avinash Tiwari
We talk about reducing human intervention automation is the key but what we saw what are the new areas that people are looking at as
Avinash Tiwari
Far as the automation is concerned automation is given have to be in place uh at least we talked about eighty two hundred percent of
Avinash Tiwari
Automation in terms of your functional unit uh uh testing has to be there but how do we uh speed this up further right is
Avinash Tiwari
The question most of the organizations are struggling with because automations are still quite fragile in a lot of cases so what we saw was
Avinash Tiwari
Use of ai a lot of organizations have started using ai to improve their automation in different areas and this gives you a sense of
Avinash Tiwari
Which are the areas where organizations or the companies have started using ai so test management test automation is a big chunk of it identifying
Avinash Tiwari
A behavior pattern and since it's a multiple choice question i mean that's the reason the percentages are different um
Avinash Tiwari
Automation as i said is a big piece of it and test coverage predictive analysis um are some of the areas where customers are already
Avinash Tiwari
Using ai to improve their efficiencies right uh to give you a sense of uh what we do as far as the ai is concerned
Avinash Tiwari
So we have been able to create bots some of you talked about rpas so we have been able to create bot for mobile app
Avinash Tiwari
Testing which means you just pass on your apks and the bot will traverse through the application and will do the testing completely on its
Avinash Tiwari
Own so that's the kind of automation we look at we you don't even have to write scripts the bot can identify the patterns or
Avinash Tiwari
The flows within the application and perform a lot of testing of course there are areas where the bot cannot do testing but at least
Avinash Tiwari
50 to 60 percent of coverage you can achieve with bot and rest can be done through scripts so that's the way you can further
Avinash Tiwari
Speed up your automation so you have to look at techniques beyond what is available right now
Avinash Tiwari
And that is where especially in the test automation one area which where you can really apply uh ai is the visual uh testing so
Avinash Tiwari
Apart from um functional testing or the the back end uh testing that we do for for our applications when we talk about the consumer
Avinash Tiwari
Experience the visual part becomes very key and especially on the application side you have to test it across variety of devices the layout the
Avinash Tiwari
The colors how does it look that visual testing is a very conversion task and that really a lot of time defines the experience of
Avinash Tiwari
The app when it goes in the hand of consumer a lot of you answered that question as to ui plays a big role right
Avinash Tiwari
So visual ai can play a big role in improving your automation and bringing additional layer of automation coverage uh through the um through use
Avinash Tiwari
Of ai individual testing automation and there are a lot of tools coming in the market we have done a lot of work but my
Avinash Tiwari
Suggestion is to think about utilizing some of the material available in the market to start using visual ai for your testing google has extremely
Avinash Tiwari
Uh well-developed uh visual ai apis we can which you can directly use and start automating your testing
Avinash Tiwari
So that's a key trend that we saw a lot of organizations have already adopted it apart from that you can start looking at other
Avinash Tiwari
Areas like test management test coverage to start implementing ai and further improve it
Avinash Tiwari
That's the third trend that we saw use of ai now we are moving to the fourth again a question to all of you uh
Avinash Tiwari
What's your take on the low code app development and testing platforms can it increase the speed of your testing or app development uh this
Avinash Tiwari
Is something very very interesting i really want to see what see what what your thought is
Avinash Tiwari
Awesome so 80 of you say that i am confident they
Avinash Tiwari
Will great um looks like there are less number of developers in the in the crowd
Avinash Tiwari
Because that's where we get a lot of resistance but yeah and that that this gives us a good uh perspective and it kind of
Avinash Tiwari
Aligns with the trend that we see um so gartner predicts that 66 of enterprises will will use some kind of low code platform by
Avinash Tiwari
2024 because organizations really want to focus on the the business value creation rather than focusing on the the the coding part of it and
Avinash Tiwari
The the techniques of ai and all is really helping in terms of speeding up the uh the development uh itself by automating a lot
Avinash Tiwari
Of code creation right and it also helps in creation of multi-platform applications so you you don't have to write separate code for android and
Avinash Tiwari
Ios you just create your components and then it spins out the code automatically for both android and ios and also maybe for smart watches
Avinash Tiwari
For other platforms so that's where the low code platforms comes into play uh and it's going to play a big role in in the
Avinash Tiwari
Overall app development industry itself um and same thing we are seeing uh in the case of uh automation as well i mean if you
Avinash Tiwari
Look at uh the journey over the last four or five years the the usage of open source tools have been on the rise uh
Avinash Tiwari
Especially in the app industry for example appium plays a big or has a big chunk of the overall automation piece as far as the
Avinash Tiwari
Mobile apps are concerned and same with selenium so open source uh tools have been kind of dominating the market but we are seeing now
Avinash Tiwari
Increasing demand of the low code tools because enterprises are realizing that automation cannot be in silo it can't be given to one team which
Avinash Tiwari
Is a which is expert in coding right we need all our test teams or dev teams to code as they develop and that can
Avinash Tiwari
Only happen when the automation is faster can be done without writing too much of code
Avinash Tiwari
You just need to know the business logic and you should be able to write the script so that's where the low code platforms are
Avinash Tiwari
Again on the rise uh in the automation space so if you're planning your automation strategy you can start thinking about uh whether the low
Avinash Tiwari
Code platforms can be used in your situation so low code can be also called script less whatever is the terminology that you want to
Avinash Tiwari
Use that's fine but that's something is on the right still a large percentage of it is on the open source uh platform but yeah
Avinash Tiwari
We are seeing a rise which is aligned to what uh we are seeing the trend in the development space
Avinash Tiwari
So that's one that's one big trend that we saw uh
Avinash Tiwari
That's this is going to be the the kind of last trend fifth one that we are seeing so again a question uh what are
Avinash Tiwari
The digital channels that your organizations focus is on uh is it app is it web is it your smart watches so what are the
Avinash Tiwari
Different channels that you're using for your app is it just one interface or you have multi interface that mobile
Avinash Tiwari
App web mobile smart watches yeah great okay so that's uh that gives us a sense now what we see is
Avinash Tiwari
Yeah so what we see here is uh as as you rightly as all of you rightly suggested in the answer of your question there
Avinash Tiwari
Are multi platforms for the same application and that's one of the business advantage uh any organizations or any business wants to get to target
Avinash Tiwari
Their customers across multiple interfaces so the the trend that we have seen is again
Avinash Tiwari
Customers are building more hybrid apps and they're not only restricted to mobile and web the interfaces across variables smart speakers alexa siri all those
Avinash Tiwari
Interfaces are kind of on the rise and as part of the testing again you have to start planning how do we do uh this
Avinash Tiwari
Multi-interface testing because testing only on single interface is not good enough now there are applications where customers can uh do some order on from
Avinash Tiwari
Their smart watch and then go and track it on their mobile phones
Avinash Tiwari
So there has to be a seamless experience between these two interfaces and until unless we are testing it from the consumer point of view
Avinash Tiwari
How they are using the the application across these two interfaces will not be able to execute those scenarios and if the experience is bad
Avinash Tiwari
The application will fail and very interesting example is the pizza hut anywhere delivery you can search on the internet and find out how they
Avinash Tiwari
Implemented almost more than 15 interfaces for their pizza application delivery beat from this the slack application to mobile to smart watch to a button
Avinash Tiwari
In the kitchen which can enable pizza delivery so that's the kind of environment we are in where you have to think about multi uh
Avinash Tiwari
Platform application development uh to serve the the need of the consumer and that's what comes into uh the new kind of testing strategy which
Avinash Tiwari
Is the multi-experience testing now uh you can we have written a big paper on how do you do multi-experience testing we'll go and take
Avinash Tiwari
A look at it but just to kind of sum it up uh it's not about testing across interfaces so you test your application you
Avinash Tiwari
Test your web you test your smart watches that's not multi-experienced system multi experience testing is putting your customer um in your view and then
Avinash Tiwari
Thinking about end-to-end scenarios and then planning how do you test it right so it could be for example in case of starbucks they look
Avinash Tiwari
At how customer walks in in the store and then how they order it how they then pick up the order and go back how
Avinash Tiwari
Do they sit on the table and how they walk outside the store and go into the car and what kind of experience they have
Avinash Tiwari
So until unless you start looking at that holistic picture of your product or service uh you'll not be able to think about a multi-experienced
Avinash Tiwari
Testing scenario right so i'm just emphasizing here that multi-experience testing is not a different interface testing it's a complete customer's journey mapping that you
Avinash Tiwari
Have to look at so again you can go and take a look at the article that we have written but this is the future
Avinash Tiwari
Of testing if you're a mobile application tester you start looking at how do i test other interfaces and create a complete integrated scenarios if
Avinash Tiwari
You are a web how do i test others so one skill set will not be enough as we go into the future it is
Avinash Tiwari
A multi-experience testing environment that we are in and we can't live in the silo so that's the fifth trend that we saw
Avinash Tiwari
So these were the five trends which we wanted to highlight uh so the first trend that we saw was a rise in adoption of
Avinash Tiwari
Continuous testing methodology uh with two concerns like low coverage of automation and still slightly lower
Avinash Tiwari
Side implementation of test orchestration we saw a increase in the testing infrastructure migration and this is something extremely critical if you have not done
Avinash Tiwari
That start thinking right now because uh similar situation can arise again and the businesses cannot survive this time the businesses who are agile who
Avinash Tiwari
Can just switch to any mode is the kind of businesses who will survive going forward third trend was uh how do we speed up
Avinash Tiwari
Automation further how can we add more layers of automation which are not the traditional ones like functional or your unit testing so that's where
Avinash Tiwari
Use of ai in the test management in test coverage in visual testing is something you start looking at uh the fourth trend was use
Avinash Tiwari
Usage of low code development platforms along with the local uh automation platforms so uh something you need to keep in mind if you are
Avinash Tiwari
Planning for future how do i scale up my automation going forward should i keep it with one team which is in silo or should
Avinash Tiwari
I democratize it and start making sure that everyone participates in automation and for that local tools can be a big asset and lastly the
Avinash Tiwari
Need of the multi-experience testing we are living in an era where we have to test across multi platforms and look at consumer point of
Avinash Tiwari
View rather than a silo view of different interfaces so that's the trend we saw and one last kind of voice of industry we asked
Avinash Tiwari
What are the top three challenges do you face in your organization
Avinash Tiwari
So this is the answer that we got i mean the top three are like increasing the percentage of test automation uh and it kind
Avinash Tiwari
Of aligns with what we we have been asking because if you are implementing continuous testing and your coverage is low it's not in sync
Avinash Tiwari
Test infra automation is a big area of focus implementing continuous testing the challenge is in focus right now again scaling up your automation in
Avinash Tiwari
The sense how do i start running it so creation is just one piece of it but can i run it on maybe 50 devices
Avinash Tiwari
Together can i run it on 50 browser instances together
Avinash Tiwari
And and still do it in maybe a half an hour one hour depending on the kind of release cycle that you have that's a
Avinash Tiwari
Big scaling up question organizations are facing um so these are some of the challenges that you uh we saw and i'm sure some of
Avinash Tiwari
You uh would be kind of already working on these areas um
Avinash Tiwari
So with these uh challenges and uh the insights that uh we showed you during the presentation i hope uh
Avinash Tiwari
You have certain pointers in your mind which you can go ahead and implement it uh if you have any questions feel free to share
Avinash Tiwari
Your thoughts uh in the question and answer session or you can always reach out to us uh for for a more detailed discussion we
Avinash Tiwari
Would love to hear your thoughts uh we always uh look at sharing the knowledge uh and it's always on the both it always both
Avinash Tiwari
Ways so we'd love to interact and and get more insights from you there are some additional resources that you can go and look at
Avinash Tiwari
And i would like really advise you to go and follow our linkedin pages so that you can start getting these updates and as i
Avinash Tiwari
Talked about there are a lot of resources already available which you can go and read and get more insights on what we talked about
Avinash Tiwari
So thank you so much thanks for attending uh if you have any questions we have five minutes left uh feel free to just drop
Avinash Tiwari
Your questions in the question answer session we'll be able to take that
Avinash Tiwari
Up so there is a question can you please briefly tell me about concept of cloud testing
Avinash Tiwari
So what i mean from our side when we are saying that uh the tools have to be on the cloud so just to give
Avinash Tiwari
You an example for mobile application testing you can have a physical device lab you can buy certain devices for your teams keep it at
Avinash Tiwari
One center place and then people can access it that's a very traditional way of using it when we are saying you have to move
Avinash Tiwari
To the cloud it means that you need to take that device lab on the cloud so either use uh maybe uh some some of
Avinash Tiwari
The existing cloud providers like key cloudy uh who are uh providing these access to the devices on a web browser from anywhere or uh
Avinash Tiwari
We can help you uh move this physical device infrastructure to a cloud so you can still use your existing devices but that will become
Avinash Tiwari
An internal cloud for you uh so that your teams from anywhere can start using it that's just one example uh similarly there are other
Avinash Tiwari
Tools like test socket orchestration maybe if you have a physical server where you are deploying your test environment you can move it to aws
Avinash Tiwari
You can move it to maybe azure and then create scripts so that these happens automated and on cloud which can be accessed from anywhere
Avinash Tiwari
So then you are not dependent on any physical physical infrastructure in your office or if you have your own data centers which is accessible
Avinash Tiwari
Uh from from different locations the point is that uh here from my perspective the meaning of cloud is you should be able to access
Avinash Tiwari
It anywhere uh and all your teams should be able to access that infrastructure right from anywhere that's the kind of concept
Avinash Tiwari
I talked about when i said cloud yeah the question is around visual ai that's a great question uh now just to give you an
Avinash Tiwari
Example for ex uh let's say you have developed a e-commerce application right and uh it's a mobile app or a mobile web application now
Avinash Tiwari
If you open uh on a particular device the on the right side there is a cart icon
Avinash Tiwari
Now on one particular device the cart icon looks small on another device it looks like slightly stretched
Avinash Tiwari
Now how do you test this though the card functionality is working the card functionality is working on both the devices but on one particular
Avinash Tiwari
Device it's stretched it's blurred on the other device it's working fine now if you have to compare it manually across let's say 20 50
Avinash Tiwari
Devices depending on your customers segment it's a huge effort can you automate it right so what we are saying is that whatever you test
Avinash Tiwari
Through your eye which cannot be automated right now can be tested through visual ai now there are ai tools for example google provides an
Avinash Tiwari
Api where you can train the api to say that this is the cart icon which is acceptable to me so then the api will
Avinash Tiwari
Run and find out if the cart icon matches on all the devices if it doesn't it will highlight so as a report you will
Avinash Tiwari
Get that okay these are the devices where the cart icon is not matching for me so it's a complete image to image kind of
Avinash Tiwari
Kind of comparison that happens uh rather than any any functionality level so functionality level automation you're already doing but you can add a layer
Avinash Tiwari
By doing these kind of visual verification by means of ai earlier the image comparison was very complex because ai was not in place but
Avinash Tiwari
Now with the advanced techniques of ai this visual comparison can happen in fraction of second as i said google has a i mean a
Avinash Tiwari
Big and one of the best libraries that you can get for visual comparison so you can start using it and there are automation tools
Avinash Tiwari
Also available in the market we also have that capability where uh you can just give your base image and it will start comparing all
Avinash Tiwari
Your other interfaces and give you the report at the visual level so that that's what i meant about visual ai
Avinash Tiwari
Another question what are some of the other ways that we can use ai in our testing strategy at the moment so uh if you
Avinash Tiwari
If you uh remember the slide there there are there are different areas like test management test coverage uh where ai can be used so
Avinash Tiwari
For example if you uh if you are using some tool uh where you are already capturing bugs now if you start analyzing those bugs
Avinash Tiwari
And start kind of creating data patterns around it uh you can do lot of impact analysis for your future releases so uh if you
Avinash Tiwari
For example if you have thousands of bugs or maybe some of the large product can have more than ten thousand bugs now if you
Avinash Tiwari
If you analyze the data point and feed that into some kind of ml algorithm or algorithm any new feature release that comes you can
Avinash Tiwari
Predict where the potential of failures are and based on that you can start planning your testing so rather than i mean right now the
Avinash Tiwari
Very standard technique is okay i have the regulation so i'll run all 100 regression suits that might take probably days to finish but if
Avinash Tiwari
I know that these are the potential areas where the the failure can happen and we have done that i mean that's called impact analysis
Avinash Tiwari
But that used to be a very manual kind of process but now with the use of ai you can do it in a much
Avinash Tiwari
More predictable way and you can analyze as much data as you can like if you have even maybe 50 000 bugs you can analyze
Avinash Tiwari
That but once you that's one time effort but once you do that you'll be able to predict where the potential bugs could be and
Avinash Tiwari
Just focus on testing that area rather than doing a complete testing so it can completely transform the efficiency efficiencies of your team so there
Avinash Tiwari
Are a lot of such ai based techniques that can be used in testing visual ai is a big as i said test coverage predictive
Avinash Tiwari
Analysis predictive analysis is what i spoke both impact and predictive analysis falls under similar category
Avinash Tiwari
So these are the areas where you can use ai to improve your
Avinash Tiwari
Testing uh another question is how scriptless platform will help in testing
Avinash Tiwari
Very interesting uh what happens is see there are two strategies that you can take right one is let's say you have a very dedicated
Avinash Tiwari
Automation team which is using uh the the automation tools maybe appium selenium to write the scripts and then they pass it on to the
Avinash Tiwari
Other teams to start using it or maybe they are responsible for execution
Avinash Tiwari
But that's not very scalable model because you are dependent on one team what if in your in your agile environment as and when features
Avinash Tiwari
Are developed your manual testing team or your business users or your app developers itself can start writing the automation code right
Avinash Tiwari
If you if you expect the business users or manual testing team to be expert at coding it becomes quite challenging but if you give
Avinash Tiwari
Them an interface where they can use their business knowledge where they can use their product knowledge to create scripts they'll be more than happy
Avinash Tiwari
To do that so while they're the way they're writing their manual test cases instead of writing manual test cases they can write directly in
Avinash Tiwari
The in the script list platform and that will give you both your test case as well as your automation script so that again changes
Avinash Tiwari
The complete game you can slowly start moving away from manual testing itself your manual testing team can become automation tester if you are able
Avinash Tiwari
To use the scriptless platform effectively and we have example uh in in our cases our customers have completely moved from manual testing to behavior
Avinash Tiwari
Driven development behavior-driven testing and doing testing completely in automated way using the tools so it's definitely possible and there are a lot of strategies
Avinash Tiwari
That are already available we can share more details on it
Avinash Tiwari
Another question isn't uh it too early to implement low code or d scriptless development platform or should we wait for few more years um
Avinash Tiwari
No i mean as i said a lot of organizations have already started using it and the uh the early adopters get the the better
Avinash Tiwari
Advantage the the good part is the low code automation platforms are now quite mature which was not the case uh five six years back
Avinash Tiwari
So the the movement that started uh five six years back around uh scriptures automation development uh fizzled out because those platforms couldn't scale up
Avinash Tiwari
But now we have reached a situation where these platforms are quite capable and again these platforms are using a lot of ai and all
Avinash Tiwari
To generate these scripts much more effectively uh earlier the dependency was on
Avinash Tiwari
Only object identification based on certain uh properties but now these have evolved a lot and and that's where the scriptures platforms also have uh
Avinash Tiwari
Changed and much more mature um so that you can you can use it much more effectively so we should start now uh early adopters
Avinash Tiwari
As i said uh gets the most out of it
Avinash Tiwari
So there's this it's not a time to wait great i think we have already exceeded the time uh thank you so much for being
Avinash Tiwari
There with us um great question and great interaction with all of you i hope uh you got some insights i've got some takeaways for
Avinash Tiwari
You feel free to reach out to us we'll be more than happy to answer any questions and connect with you thank you so
Avinash Tiwari
Much
