Avinash
So we all are seeing a digital revolution around us and I'm sure each one of you must be experiencing the impact of this change
Avinash
In your team's projects or organizations and which means that you need right strategies and solutions to evolve with me to make this pace of
Avinash
Change and today's session is focused on focused on the trends strategies and solutions in this era of mobile first or mobile everything and I
Avinash
Am extremely delighted to welcome our guest speaker from Forrester I have with me Diego who is vice president and principal analyst horriston he has
Avinash
Close to 28 years of experience and he contributes to and advises on foresters offering on app development and delivery moreover he is one of
Avinash
The known experts on SDLC processes and practices so without taking much of your time I'll ask Thiago to start the session
Avinash
So da will take up the trends and strategies for a mobile enterprise and I'll be taking up a quick walkthrough of the solution that
Diego
We have towards the end of this session so Diego over to you I'm making you the presenter thank you very much I mean ash
Diego
And good morning good afternoon depending where you are in the world can see the slides all right great so first of all I finished
Diego
Thanks for thanks for having me and and I also would like to thank everyone who's on the line that's spending you know some of
Diego
That time to listen to us I'm gonna be sharing some of the research in this in this very trendy area
Diego
Raised on my on my testing and agile coverage so just a quick background I mean I don't think I need to remind anyone but
Diego
We know that digital is basic accelerating we are just at the start still at the starting phase although it's been going on for five
Diego
Years I would say we still have another 10 years of of digital transformations that everybody is trying to you know aggressively move towards and
Diego
What this means is really that lots of teams are trying to change their touch points the way they service customers the apps that they
Diego
Offer to customers but you know changing touch points it might sound simple and something at the surface but actually has some very in-depth consequences
Diego
Right it's got it comes with changing operating models it comes with impact on the backend systems but also with mobile and with all these
Diego
New technologies that customers are experimenting with day-in day-out it just becomes even more interesting I would say more engaging with the type of apps
Diego
That we can build but but again things have to change in order to create those digital experiences and things have changed you can see
Diego
That the way mobile apps are being built have kind of changed the way we think about development definitely has to be agile it has
Diego
To be kind of hypothesis driven we want to drive some new experiences new ideas and test them quickly test them in all senses putting
Diego
Them out and deploying them and especially what mobile has changed is this this idea down here of measuring and analyzing and sensing right what
Diego
Their applications are actually how they're being perceived right once you launch these apps on mobile phones you can get feedback you can get feedback
Diego
From users you get feedback through the app itself there's feedback on social there's there's there's there's this very relevant feedback loop that really allows
Diego
Us to kind of respond to changes respond to what's being sensed out there in the market once you deploy these new applications and so
Diego
Mobile development and the you know agile and DevOps as you will see are all kind of ways to to support these new new ways
Diego
Of working and yes I think what we all mostly hear about and and and I guess there's no that there there is no you
Diego
Know second thoughts about this is business wants speed they want these applications these mobile apps to be delivered fast these experiences to be delivered
Diego
Fast but don't get you know let's not kid ourselves it's not just speed it's really speed with quality who wants a four star or
Diego
A three star application when you go and you choose your app that you want to download and you want to run with it has
Diego
To be five stars at least that's what I aim to write unless I'm forced to get a three star or a four star but
Diego
I try to avoid if I can and so I like this metaphor of the Formula one where speed does not necessarily have to compete
Diego
With quality in other words these guys have made quality part of the strategy to win the race by bringing down changing four wheels in
Diego
In 2.1 actually 1.9 seconds I should say recently thanks to Red Bull in changing four wheels in less than two seconds from 10 seconds
Diego
Mindset of of how testers should be thinking about quality right it can't be an afterthought anymore it has to be embedded in early on
Diego
Right that's what this is meaning it's meaning that quality is a problem of all there's a team of people working together to achieve to
Diego
Achieve those you know levels of quality that don't necessarily compromise speed that's why I talk a lot about quality at speed and and so
Diego
You know speed comes in and quality comes in in in various forms of course with with mobile I guess the biggest form that we
Diego
All want to enjoy is having a great experience right so user interface definitely is a big is a big thing here the experience has
Diego
To be engaging it has to be fun the what the application is doing has to be useful
Diego
And but also at the same time it has to perform right I mean we all get frustrated when when that little icon comes on
Diego
Your phone and you don't know what's going to be happening
Diego
You know after it actually if it comes back and you don't have to kind of put turn on and off the phone again
Diego
And if it does come back you don't know what happened to maybe the transaction or the or what you were doing with the application
Diego
And so you know performance also contributes to to your customer experience your experience in using the phone now with mobile of course we have
Diego
Some additional challenges compared to when the world didn't have mobile phones around and this is just showing the huge amount of different device models
Diego
That you might be challenged you know by testing on you don't know your customers around the world which ones they're using they could be
Diego
Using many of these they could be using some of them they might be using also different versions of the APRI operating systems they might
Diego
Even be using different web browsers and versions of web browsers now if you combine all that together the numbers can be quite the staggering
Diego
This is not an easy problem to solve and the equation and it definitely you can't solve it manually in your console and you have
Diego
To solve it in a way that you can do a lot of of course we use a leverage because otherwise it will take forever
Diego
And testing will really you know will be kind of confined into some into some final step if I've ever done and so and teams
Diego
Are kind of you know organizing of course for this here's some data that shows how teams in 2017 have been have been testing mobile
Diego
Web sites and mobile web applications against their devices there's a tactical approach of using sometimes of using you know employees own devices I think
Diego
This number is quite high but this probably also reflects some of the crowd tests with crowd-sourced testing that system integrators do and by you
Diego
Leveraging right there they're their resources and and you know there's there's many large system integrators that we pros the TCS is the emphases that
Diego
The tech mahindra is and so forth that have lots of resources that can be doing this and they offer testing services of course and
Diego
Then you've got you know a less tactical but still practical use of an on-site library of physical devices to test again but the two
Diego
Biggest ones I would say are and the growing trend I would I see on the on the between the the service you know service
Diego
Or emulation to test mobile in an emulated way versus 56% which is the biggest number here on using a cloud and with real devices
Diego
Attached to the cloud and despite all that of course you know automation as you saw I guess especially in the mobile world is becoming
Diego
More and more prevalent we can't just do manual testing but in general this is you know about developers that that do general development mobile
Diego
And non mobile there is not a lot of automation going on at least not enough I would say some developers still do only partial
Diego
Unit testing now maybe that could be a good thing if we knew that they were doing risk-based unit testing in other words they you
Diego
Know would would make sure that they're testing the unit testing the most and high risk is riskiest areas of their code but I'm not
Diego
Sure that's what's going on so that number should be higher anyway and and functional maze testing UI LED testing is 15 percent API testing
Diego
Is quite low this is something that we really need to fix I think especially if we want to be more successful with mobile testing
Diego
In an agile world right so what do you know what do some of the leading organizations do and what I recommend you guys do
Diego
If you are you know in this in this a journey of transitioning towards digital well first thing is QA has to you know it
Diego
Has been slowly moving into the development but you have to have your developers or you have to have your testers be more development driven
Diego
In other words they have to know about development they'd have to know about languages programming languages some of them might even be coders but
Diego
Be in order to automate more they have to go beyond the user interface and Deus you know API testing become more technical you can
Diego
See this is starting to happen here you know you can see that more than then then then then you know then 20% are spending
Diego
You know over between one and four hours of writing in writing new test automation code or they're spending the number goes up if you
Diego
Look at you know the the testing new code up to 40% 44% are testing new code daily right this is spending more than between
Diego
One to four hours every day on testing so this is a trend that has to definitely increase and move on but it's it started
Diego
And I don't think it's going to stop but I also predicted some years ago especially when I started writing about agile was and amazed
Diego
On what I was seeing you know large customers like Lloyds Banking having years ago a huge testing centre of excellence and then squeezing that
Diego
Down to a much smaller group and many others have followed that paradigm is is going from a centralized testing center of excellence that kind
Diego
Of performed all the testing right so at the upper part of this picture down to more of a federated concept where you've got a
Diego
Centralized practice center with fewer experts fewer automation designs or QA engineers as people would call them or maybe some performance integration lab as experts
Diego
But most of the testing moving down inside the teams right testing happening in in Sprint's base in other words and that's been a trend
Diego
That that has been going on for four years at least I would say and and and and so what's happening is that you're getting
Diego
Testers dedicated allocated directly into development teams and and you have a smart group of of a centralized service team which could be physical or
Diego
Could be virtual but it's supporting those teams in being successful and you know they might be choosing the tools to use they might be
Diego
Coming up with patterns and design patterns to increase the level of automation and so forth and those are you know kind of shared across
Diego
A number of teams and you don't have to take my word for this but you can see the numbers I've been monitoring this and
Diego
This is from my last global agile survey 2017 that I when I ask specific questions around how they're organized 64% would agree that testers
Diego
Are members of an integrated delivery team and 51% would say that today are also allocated full-time to project team so that means they're doing
Diego
One project at a time they're in you know the one product development there inside the scrum team as a first-class citizen so that's a
Diego
Good news for testers because they're part of that scrum team or agile team together with pelipper's and other and other types of roles the
Diego
Other thing is organizations that are trying that are being you know again supporting digital transformation
Diego
You know we know that successful digital transformation requires very good software delivery practices very strong delivery practices you have to be excellent at building
Diego
The designing building integrating testing software and applications and so you know if that's the case what is there around that can make that happen
Diego
Well it is it is it's been a jold for some years but recently we know in the last two three years DevOps has been
Diego
Picking up and is still early days but it is picking up but you can see that from these numbers actually when you're doing just
Diego
A jille those that are doing just a j'l are are claiming you know are are benefiting less from those that are doing both agile
Diego
And DevOps and even in this quality space you can see how really interesting these numbers are in terms of improved technical quality goes from
Diego
29% to 72% if you're doing agile plus DevOps versus doing agile alone or improved functional quality goes from 47 to 72% and you know
Diego
Well when there's there's a lot of implications on why this is happening and then the practices the automation levels that DevOps brings the fact
Diego
That people are checking code every day integrating into a single trunk integrating you know more and more and testing that integration so that's what
Diego
I think justifies these these these increase in in the numbers in doing agile alone or doing agile plus DevOps and some of you know
Diego
When I talk to some clients and all religion I say well it's kind of obvious that if you're doing DevOps you're doing agile well
Diego
I would say pay attention to what your teams are doing because it isn't that obvious and I have bumped into organizations where they have
Diego
Two separate initiatives for agile and DevOps agile is seen as something that the development teams are doing and DevOps is something seen sometimes as
Diego
Something of the ops folks but really what we're talking about is a joint initiative and testing is right in the middle of all that
Diego
Another important trend and and thing you know that you should do if you want to be successful with with with mobile development and testing
Diego
Is and in an agile world is having dedicated cross-functional teams cross-functional or integrated product teams with a product owner from the business and having
Diego
You know this mixed team of developers and QA xand lead architects all dedicated into that team with also some external roles that are going
Diego
In and out going in and out and supporting these folks to be successful examples are of course you might have some ops folks involved
Diego
So that they know you know what type of capacity what type of a agile infrastructure they need to put in place to support these
Diego
Teams you might have some you might have you know you might have the testers inside the teams but the guys that provision maybe a
Diego
Cloud device environment which might be centralized but the team has to make sure that they get access to all that infrastructure and services in
Diego
A self-service way but it's really it's really these cross-functional teams that are kind of the pulsing heart of any digital digital oriented you know
Diego
Delivery organization the other important thing is that we you know how to increase the level of automation well we need to go definitely we
Diego
Have to shift make a shift of of increasing the amount of API testing versus the the level of UI LED type of automation testing
Diego
And you know this this this really you know these are kind of some aspirational numbers but today most of it is it's basically manual
Diego
Sixty to eighty percent or even more is manual testing we have to invert that and make that automated and to make that automated we
Diego
Do need to increase the way we do how we organize our automation testing we have to be more architectural driven in doing that automation
Diego
Testing record and replay and our maiden final tests are not enough right we need to go beyond beyond the UI because we because the
Diego
Architecture of the applications are you know more distributed we've got web services you've got containers you've got server list that is coming and you
Diego
Can't just you can't just you know test the front end of your application if the back end if the problems are in the back
Diego
End and so there needs to be some connection there and there needs to be broader understanding of what's going on but it can't be
Diego
Done manually it has to be done in an automated way what that means is really what this really means is is automating through you
Diego
Know basically having these developers stack developers and testers that kind of go beyond that user interface right this is exactly what I was what
Diego
I was getting at a minute ago and and and being able to automate through the stack so we here you know we hear more
Diego
And more about full stack developers for example that or full stack testers that can can actually connect really achieve this the last thing let's
Diego
Say before before another an ultimate point around some newer trends on testing is testing with continuous delivery that is if you're trying to reduce
Diego
Continuous delivery you can't you know you're kind of obliged to do continuous testing because it's like a you know you're you're you're in the
Diego
Middle of all this you're working with the developers you're working with delivery you're inside the the process and if you start if you don't
Diego
Automate if you don't test continuously you're not you know you're gonna basically be slowing down the whole the effect is going to be a
Diego
Slowdown on the overall delivery time and so continuous testing is kind of a must because it has to support continuous delivery and continuous delivery
Diego
Is where everybody is trying to go to to be able to deliver in smaller chunks and more frequently and so what happens is testing
Diego
Happens basically along the entire life cycle during ideation planning during the build time during the continuous integration which kicks off all the tests unit
Diego
Testing functional testing non-functional testing even performance testing done within Sprint's automated and you know you have to also deploy and how to make releases
Diego
So you want to have the release that is a good candidate but to be a good candidate and how to make the fact that
Diego
It is a good candidate and then have it deploy in an automated way you have to have automated functional tests so that the so
Diego
That the system can can make that decision based on data right and then you've got also considering you continue setting the feedback then like
Diego
A retesting perhaps or or collecting feedback from what's going on into production and and embedding that back into the quality of what's being built
Diego
And so continuous testing is you know really a capability of people process and technology and in any delivery pipeline you know you're gonna have
Diego
Features that are going to be deployed and have to be tested on mobile are gonna be tested on web are gonna be tested on
Diego
Thick clients perhaps you know nobody just has a mobile phone as their target deployment world it's a mixed heterogeneous world right with with lots
Diego
Of different types of devices and continuous testing has to address all of that and last comes the new let's say frontier which is using
Diego
AI and artificial intelligence and specially machine learning to improve the way we test I ran this this I developed this research about a year
Diego
Ago end of 2016 2017 was when it actually really last six months the download has been growing dramatically and it's a heat this is
Diego
A heat map that you can see here which shows that companies you know experts system integrators vendors are planning on using AI more and
Diego
More in the test face test is you know of course you know you're you'll have the Microsoft's of the world or the Google's and
Diego
Some other of these big vendors IBM's maybe introducing AI also in other steps of the software development lifecycle but testing seems to be the
Diego
Red hot area where there's high interest to apply artificial intelligence and and and the number of things there's a number of use cases that
Diego
People are looking at that AI can really help with which is okay you know I just said we have to automate more well yes
Diego
We do have to automate more but maybe we also have to automate smarter in other words do I have to automate everything are there
Diego
Test cases that maybe are not those at high risk that I could avoid testing more with can I find out maybe what I can
Diego
Better test next are based on what I have and if you've got data and which you which which you if you don't you can
Diego
Collect but if you with the amount of data that teams generate with all the projects that have been going on and that you can
Diego
Start collecting you know log files data from Chiara if you're using JIRA as a source code you know as a as a repository a
Diego
Source code repositories and project management type of data all this data and testing data test cases that passed test cases that don't pass which
Diego
Test cases are provisioned all that data can be given into input over to to machine learning to model the algorithms that can start making
Diego
Some really interesting correlations and give some really good feedback on you know what to test next or maybe finding out that there are redundant
Diego
Test cases in a big regression test suite or help identifying bugs potential bugs that would come out based on on that on on what's
Diego
Being developed so far that team members that are you know how they did this in the past there's also better testing that can be
Diego
Done if you use deep learning for image recognition much more precise than machine learning or traditional OCR type of the technology
Diego
Predict maybe outcomes of future tests or how you could in you know what would be the effect of automating certain test cases and you
Diego
Know how would that impact the percentage of automation and the speed of automation perhaps so you know I'm seeing a lot of very interesting
Diego
Use cases that both the vendors and you know vendors like Pcloudy or Pcloudy or or other tool vendors are starting to put
Diego
Into their plans and system integrators also are using these to optimize the way they test but also to optimize the services that they provide
Diego
To to to kind so I think this is you know my last slide this is my last slide by the way but I think
Diego
This is going to be an explosive area in 2018 and I kicked off some more research in this space it's it's a new stream
Diego
Of research that I'm gonna be accelerating in because I think there's a lot there really is a lot of opportunity for all types of
Diego
Testing mobile more mobile thanks to AI and with that I'm gonna hand it back to a Benesh thank you very much and sorry for
Avinash
The initial little problem you had thanks Diego thank you so much Diego for the insightful session quality eight-speed is something
Avinash
We follow as philosophy and the solution that we have built is completely built on the philosophy that you just mentioned quality at speed so
Avinash
I'll be now taking over and I'll be taking you through a quick walkthrough of the solution that we have t cloudy calm
Avinash
So let me begin by a quick introduction of the solution that we have known as logical calm so at the core of it the
Avinash
Solution is device cloud or it can be also called app testing platform the solution is designed to test all kind of mobile applications with
Avinash
Native hybrid mobile web or pwace which are new trends in the app space
Avinash
It covers all kind of testing needs that Europe that you might have for your apps manual testing we have device analytics which Diego was
Avinash
Talking about how do we decide on number of devices right of right devices for testing inbuilt test automation and
Avinash
Finally infield UX testing experience so Diego also mentioned about getting feedback from the market AV testing so all that can be done through the
Avinash
Infield testing service that we provide and with with the false kind of testing activity that you can do we are one of the few
Avinash
Players in the market to give you this kind of lifecycle AB testing experience on the platform now as a user the platform of the
Avinash
Device cloud can be accessed in two modes one is through the web interface which means you just need a browser to access the platform
Avinash
And second is we have developed lot of plugins for developers as well as if I can say DevOps
Avinash
So these plugins are like Android studio Xcode Eclipse Jenkins to allow users to access our platform within their tool sets so it could be
Avinash
Development environment it could be your build management systems it could be your test management systems so so so two modes web and plugins using
Avinash
Which the platform can be accessed the platform that we are talking about is available across various flavors and one of the popular flavor that
Avinash
We have is public cloud where one can use 500-plus real devices and we are one of the world's largest device cloud and one of
Avinash
The unique point is we have widest variety of devices on the platform so starting from the popular ones like Samsung's or Apple's to even
Avinash
Phones from China market like zombies or plus we have real Sims available within the phone so you can test your applications with real networks
Avinash
And we also have the phones distributed across four locations of india-us Philippines and Australia which means you can test it test your apps on
Avinash
The local regional devices on local networks as well so apart from the public cloud we also have two other flavors of the platform we
Avinash
Call it private cloud which means we can create a dedicated instance for a customer
Avinash
So that customers can access the devices 24 by 7 in a completely secured environment and last is the optimized cloud where the complete platform
Avinash
Can be deployed within your organisation premised so let's say if you have already invested in devices and you have teams located across various locations
Avinash
You can create a cloud within your organization premises and then give your team's access of the cloud or the device infrastructure and it is
Avinash
Within your secured boundary so you can you can give access to the teams they way the way you want or the way you want
Avinash
To control so with this quick intro moving on to where does the solution fit in the app test lifecycle so we have categorized into
Avinash
Three different phases one is the pre testing phase you where you plan your testing and one of the key planning that happens is how
Avinash
Many devices that we need for testing of the application and it it is based on various parameters like market or the user segments etc
Avinash
So that's the first stage the second stage is where the development and testing happens in parallel specially in the agile and DevOps mode so
Avinash
You do your manual testing you require devices for debugging you you want to automate your test run your tests on parallel devices and then
Avinash
Integrate the system with CI and create continuous integration deliveries and last is where the pre-launch stage comes where you want to take the feedback
Avinash
From the users where you want to involve real crowd users to get the feedback before you launch the product in the market so these
Avinash
Are the three different phases where our solution can fit and I'm going to give you a glimpse of what we have considering the time
Avinash
That we have for this session I'll not be able to cover all the features that we have but I will try to give you
Avinash
A glimpse of what the solution offers in the complete lifecycle and also emphasizing the theme that Diego talks about quality at speed so let
Avinash
Me begin with the first step that you can take with the product which is pre testing stage where you want to figure out how
Avinash
Many devices that I need for testing so if you log into the platform we have something called device planner which gives you a real
Avinash
Time data of popular devices or market penetration of a specific device across the global geography so as you can see here in this slide
Avinash
We have selected India as a country and I have selected my target market segment as 25% and I can get the list of those
Avinash
Devices which will cover 25% of my market cycle and if you can see in slightly more detail so zyo me rodney 3s has the
Avinash
Top market segment in India so if I have to plan my testing I should first test it on xiaomi redmi 3 yes if my
Avinash
App is designed for India similar similar analytics is available for all the countries so this is a real time data if you change if
Avinash
You check it make next week probably - the data will change so it's a real time data that we are collecting from the market
Avinash
And we have done some partnerships with analytics companies to give us this data which is a very very important step for you to plan
Avinash
Your right testing so that you're not missing on your test coverage that's the first part of it now that you have figured out what
Avinash
Devices should I plan for testing the our firm gives you as I said earlier widest variety of devices widest variety of real devices so
Avinash
All that data is available at one single place within the platform and we call it remote access so as you can see in this
Avinash
Slide we have a variety of devices available on the platform and those devices can be filtered based on your criteria is like operating system
Avinash
Manufacturers screen size network availability or location of the device devices
Avinash
You can this page you can see the summary of the devices or the complete information of the device before you start testing on a
Avinash
Particular device you can also book a device right from here so let's say I find my device and I want to book it for
Avinash
A long duration for a future need I can do that right away I can specify the time and duration for which I want to
Avinash
Book this device for and all the book devices will be available there in my device section where I can either cancel the booking or
Avinash
Start the testing so let's say I find a device ID and I want to start using it for my manual testing I think that's
Avinash
The first step which happens when you start your app testing so we just need to click on the connect button which is the cloud
Avinash
Like icon that we have on the platform so once you click on the cloud icon here it takes you to a new page which
Avinash
We call it device interaction page which you can see it right now so this device interaction page is the place where you have all
Avinash
The tools required for your manual app testing along with the device
Avinash
So let's just start with the basic step of installing an application so I click on install it takes me to a drive where I
Avinash
Have already uploaded my application files it could be apk ipas or my test data files and I select any application from here and say
Avinash
Install the app gets installed on the device so here right now we have installed a note application which is a sample notification by us
Avinash
Not only applications you can also test your mobile web applications by clicking on the web URL on the left side of the pane you
Avinash
Can just interviewed URL and then provide the or select the right browsers and then say launch once that is done the URL will open
Avinash
In the device in the browser that you just selected and you can pretty much perform all the operations on this webpage inside the device
Avinash
Tested for orientations or you can execute any test case that you have for the for the web page or the website or the web
Avinash
Application so I mean this is one a very simple example of how you can test your application or a mobile web application on our
Avinash
Device there are as I said there are various other various tools available on this screen to help you do your testing much faster and
Avinash
To give you write set of data to analyze if there are any bugs so in the left side and in the middle of the
Avinash
Screen you see various options which are basically the tools available for your testing so you have tools like chrome debugger so if you are
Avinash
Using a mobile web application you can use chrome debugger in parallel you can you can change the location of the device for your location
Avinash
Of your apps you have a network simulator option you can fire your adb commands you can toggle between Wi-Fi and 3G 4G on the
Avinash
Device so every every use case that you require during app testing is available on a single click on the platform in the in the
Avinash
Middle of the screen you see various options like screenshots sending text as keyboards rotating the screen gestures so pretty much what you need to
Avinash
Do one of real devices available on a single click not only that you can also track the performance of the application while your sting
Avinash
On the device so you can track your memory usage CPU usage Network battery performance while you're testing your applications on the device you can
Avinash
Also capture the logs while you are testing and these logs are available as part of reports as well so again pretty much all the
Avinash
Tools are available on a single click you can change the session name for better addressability now the platform also provides a collaboration so while
Avinash
I am testing my app one of the key thing that I am looking at is is there any bugs on the applications so I
Avinash
We talked about logs and performance but apart from that there there are a lot of functional bugs that we find out on the application
Avinash
And we want to take screenshots so we take this screenshots the screenshot is available then I'm there in the same screen here and I
Avinash
Can edit the screenshot mark the bug that I find on the application in the device save it back and then log a bug and
Avinash
Now the logger but can be within jira or the other tools but from the same screen while you are testing you can you can
Avinash
Take these steps of screenshots editing it and logging a bug directly in your bug management tools so this then brings a to collaboration between
Avinash
The tests and devs the testing tool and the bug management tool or the application lifecycle management tools not only that we we just saw
Avinash
Testing on one device but we have gone beyond again with the philosophy of quality at speed where you can test it on multiple devices
Avinash
Together and this is one of the revolutionary feature that we have just come up with where you can perform action on one device and
Avinash
The action is replicated on other devices in real time so I installed an application on one device and I can see that same application
Avinash
On other two devices in the multi view and if I perform some operation here like done logging and the same operation is replicated with
Avinash
Other two devices so we have seen this kind of operation in case of automation that you have to write script and then run it
Avinash
On multiple devices but here while you are doing your manual test you can you can see the actions getting replicated another set of devices
Avinash
So just imagine the time that you'll save during your testing and it also enables you to compare the results on various devices in in
Avinash
One single view so it not only saves your execution time it also saves your analysis time moving on once the testing is done we
Avinash
Have the reports comprehensive reports at one single place so within the reports section you can see we have reports for your manual sessions as
Avinash
Well as your automation sessions like Calabar hajj mung appium etc but let's just look at one of the report now reports are available in
Avinash
A very very detailed format so as you can see you you have the details in terms of when was the test starting when did
Avinash
It complete and the other sets of data like what happened what was the battery consumption of the application on the device if you just
Avinash
Scroll down and see the other details in the report you can see other sets of data like Network CPU memory and also all the
Avinash
Screenshots that you took during your app testing session it also has the full video recording as well as the logs available within the plot
Avinash
Within the reports itself which you can download and log it within the bulb within your bug reports or you can share this report with
Avinash
The teams after the report so this was all about the manual testing now moving on to one of the important pieces of the mobile
Avinash
App testing which is automation now platform has full scale capability to run your automation scripts on devices in parallel and as you can see
Avinash
In this tab which is automated we also call it a scheduler we support various tools like monkey espresso robotium calabash appium where you can
Avinash
Run your spray on multiple devices together by just going through these steps which are mentioned it hardly takes a couple of minutes to start
Avinash
Executing your scripts on multiple devices together now the platform also has inbuilt capability to create an automation script so what we just saw was
Avinash
You can use the open source tools you can write your scripts there an executor and Pcloudy but P Claudia also has the capability
Avinash
To give you test automation creation capability where we have the automation studio in build we call it op key now once you click on
Avinash
This tab launch and start talking it up he takes you to a different screen where you have the full access of the peak Lory
Avinash
Device and you can start doing your recording or you can do a spy on the device and the application
Avinash
So you just need to start you just need to start performing your navigations on the application and all the recordings will be captured within
Avinash
The automation studio interface so here you can see there is a step recorded clip button and all the details of that step is available
Avinash
At the bottom and once the recording is done you are back to the automation studio interface where you can see the scripts recorded and
Avinash
The script is a completely cordless script so whatever you recorded on the application is available in form of keyboard-driven scripts however I mean the
Avinash
Automation studio interface provides you all the capability to enhance this test case you can insert your own logic you can data drive so everything
Avinash
That you need to scale up your automation script is available within the interface but they're the best part of the interfaces to to be
Avinash
Able to run the scripts on multiple devices together then and there so I
Avinash
I just clicked on the execution and then it takes me to interface where I can just select all the devices from the cloud and
Avinash
I can select any number of devices and just say run which means it will run all these scripts in parallel on all the devices
Avinash
And I'll get back the results once the execution is complete and I go I can also monitor the execution in real time so I'm
Avinash
Not going to that detail right now but the best part one of the the key benefits of automation studio is for appium users so
Avinash
For example you already have your appium scripts ready and you want to enhance those you can use the automation studio here to record your
Avinash
Scripts and then export it to your appium java form form it so whatever recording that i do through the steps that we saw can
Avinash
Be exported in form of java and you can just copy paste that within your appium framework and you can start executing that either on
Avinash
Your local device or on Picaro devices as you wish so this really improves the speed of automation creation significantly gives you capability to record
Avinash
Your scripts debug your scripts by using the spy feature within the automation studio interface if there is a failure on specific device you can
Avinash
Go and do the detailed analysis so all that is available at just one single fling
Avinash
One of the big changes that we did and as diego mentioned was use of AI with in the testing phase itself so we launched
Avinash
A module called certifier which is our AI based engine to to allow users to do their apps certification so if you look at this
Avinash
Interface it's a very very simple interface where it's just asked you to select your app let's say I selected this half BM s dot
Avinash
Apk once the app is selected I just need to provide certain app credentials like if if if it's needed within the application like username
Avinash
Password I can add as many test data depending on the need of the application so I just added one field location and I can
Avinash
Provide that value so once this is done I just need to run I just need to start the session by clicking on run button
Avinash
Here and the engine will do all the testing on its own so you're not writing any script you're not teaching this engine any flow
Avinash
Of your application it will navigate through the flow on its yuan and it will perform the testing once that is done you get a
Avinash
Comprehensive report so let me just open a live report for you so this is one of the report generated on the same application BMS
Avinash
Dot apk so this report that you see here has data around your app
Avinash
CPU parameters memory parameters battery parameters network parameters and the test has been run on almost ten devices here so you can see the parameters
Avinash
Detail across various devices and this can be configured in terms of number of devices that you can choose
Avinash
Now you can go inside the device level detail to see what exactly happen on a specific device and on this device you can see
Avinash
The full data of the run that was done so for the complete session which was run by the AI engine the battery charge the
Avinash
Memory chart how the data is changing across various scenarios so you can see all this data and you can also see the full snapshots
Avinash
Taken during this flow so through the snapshot you can see what all scenarios were executed by the AI bots of course this bot is
Avinash
Evolving so you might see certain scenarios which are missed right now but it's learning on its own and it improves with every cycle and
Avinash
It has all the other sets of data like logs and scenarios so this bot can enable you to get quick feedback on your applications
Avinash
As soon as you make any change and especially in a DevOps environment when you make any change you require to test it immediately and
Avinash
Provide the feedback and that's what this bot takes care of and as as this bot becomes more intelligent you will see the test coverage
Avinash
Getting increased on your applications but you can just try and see what it does for you so I come back to the last part
Avinash
Of my discussion so with this thought where the we have designed the platform with the philosophy of quality at speed we allow you to
Avinash
Do a full life cycle testing starting from manual to automated tests crowd testing as well as import testing in a completely DevOps kind DevOps
Avinash
Environment with full integration with your existing systems I'll close the session right now and I'll open it for Question and Answer so please feel
Avinash
Free to just let let us know what you feel about the session and if you want to ask me or Diago any question feel
Avinash
Free to just put that in the chat window so
Avinash
So there is a question here this is related to the tool do you have all the popular devices which are present at the market
Avinash
So yes as I mentioned in the beginning we have more than 500 devices and we have ensured that we covered the wide spectrum of
Avinash
The devices which are needed by the customers so yes you can just go and explore and see the variety of devices that we have
Avinash
There is a question of around AI so Diago probably you'll have to take that the question is the role of AI in testing and
Avinash
What kind of trends do you see within enterprises Diego a question for you
Diego
Yeah sorry so again I would say yeah do you hear me yeah
Diego
So yeah I was just saying that you know most of the of the use cases that you saw are are what's being are the
Diego
Use cases that that that clients are using a little bit if you want it's a little bit of a push right because clients are
Diego
Not necessarily aware what you can do with AI differently them from what you can do with non AI I mean very interesting the gazaam
Diego
The example are you should correct me if I'm wrong it sounded like very you know like a bot that was doing mostly how the
Diego
Device is performing yeah and it's there right that's cool I guess I guess the areas where we're AI can be used as also in
Diego
The strategy on what to test and what not to test so therefore not necessarily replacing testers but more augmenting testers providing them insights that
Diego
They can't see by themselves right when you've got if you think about you know very large testing Suites and big big testing activities it's
Diego
No human can really make sense of all the data as a as a computer can and specially a neural network or or a machine
Diego
Learning algorithm can so the trend I'm seeing is more a support you know support and augmentation of testers so that they can do more
Avinash
With in less time and better in less time yeah absolutely agree yeah I mean it's all about augmenting the capability of the testers and
Avinash
That's also the objective of certifier that you have built
Avinash
So we'll take couple of more questions because we have exceeded the time one quick question again for you Diego
Avinash
What is your view on best fit tools for only mobile or tools which gives all the capabilities where mobile and all-in-one kind of tools
Diego
Right well I think the trend that we're seeing is that a few years ago it was mostly mobile only and people thought mobile only
Diego
And mobile first the trend I'm seeing these days that the enterprise level is is is mobile first is definitely the right way to go
Diego
Mobile only is not happening I mean it's not happening at least with the speed that people thought but I don't think it will ever
Diego
Happen because there's always gonna be lots of new interesting devices coming and when you look at them you know organizations delivering enterprise applications and
Diego
And software that software is gonna run on different types of heterogeneous
Diego
Endpoints which could be you know IOT can be mobile but they also will be still desktops they can be web browsers and so I'm
Diego
Seeing a trend of the world of development is becoming more complex but clients would like to have you know less tools to deal with
Diego
And and so testing I think what's happening is that you know you will be adding more browser functionality so that browser testing can be
Diego
Done that's how you know I think I think that's a that that's gonna be the future trend it's a it's trying to have one
Diego
Tool to kind of from a testing perspective where you can do most of the work and definitely the other trend is to have you
Diego
Know device cloud as you showed because that's seems to be a growing trend whether you know physical or or or emulated you can see
Diego
The numbers there are kind of leaning more towards physical less towards and slightly less towards a non physical or or emulated and so and
Diego
So I think that's kind of that's that's kind of where I see you know it's it's about testing digital experiences I think more than
Avinash
Separating between mobile and no mobile so we take one more last question so the question is around do we have any trial available so
Avinash
Yes you can just go to www.petland.com and register for a free trial you'll be able to access most of the features in a free
Avinash
Trial but there are certain features which are restricted like automation studio and the multi do testing that I showcased but you can request us
Avinash
And we'll be able to we'll be happy to give you access of the full platform
Avinash
So with this last question we'll close the session some of the questions that we could not answer we will get back to you over
Avinash
Email we'll try to answer that individually thank you so much for your time and patience thanks Diego for participating in this webinar hope the
Avinash
Audience got the trends and they will be able to utilize some of the insights that you give thank you so much I very much
Avinash
Thank you - thank you everybody
