Jeroline
Hello everyone and Welcome to our joint webinar hosted by Pcloudy and test house we're thrilled to have you with us today for an
Jeroline
Exciting session on revolutionizing uh digital testing using test automation so before we dive in let's cover some housekeeping rules your lines are currently muted
Jeroline
But feel free to submit your questions during the webinar using the chat option that you see at the bottom of your screen and we'll
Jeroline
Address them in the Q a section at the end and also note that this webinar is being recorded and we'll send out the link
Jeroline
Later so that you can share it with your friends or colleagues so now let's get to know the two awesome organizations behind this webinar
Jeroline
So first up is be cloudy Pcloudy is a cloud-based testing platform offering 5000 plus real devices and browser combinations for mobile and web
Jeroline
App testing key features of peak cloudy include continuous testing devops Advanced automation AI based visual testing robotic process automation real-time histor analytics and more
Jeroline
With integration with popular testing Frameworks and tools and Round the Clock premium support Peak cloudy is trusted by 300K plus registered users from small
Jeroline
Businesses to large Enterprises uh next slide please next meet Guest House a 23 year old Global software testing and quality engineering company based out
Jeroline
Of London UK with a mission to contribute to a world of high quality software testers has helped businesses deliver exceptional user experiences through Innovative
Jeroline
Quality engineering or quality assurance solutions they focus on enabling total quality management for technology driven businesses is all about harnessing change and Innovation to
Jeroline
Benefit customers uh so be cloudy and test house have joined forces in a strategic partnership to revolutionize digital testing and quality assurance this partnership
Jeroline
Combines Pcloudy is Advanced cloud-based testing platform with test house extensive experience in software testing and quality engineering together we are better positioned to
Jeroline
Provide a seamless testing experience for businesses a key aspect of this partnership is mutual expansion into new markets with test how strong presence in
Jeroline
The Middle East the UK us and Australia uh helps Pcloudy solidify its Global reach this is the beginning of an amazing partnership and
Jeroline
We aim to help more businesses deliver unparalleled value to their customers around the world so now that you know a bit about uh both
Jeroline
Be cloudy and test house let's move on to the actual main event we are honored to have George crew chief Solutions officer at test
Jeroline
House as our speaker for the day George has more than two decades of quality engineering experience uh and has worked the numerous Fortune 500
Jeroline
Clients in implementing agile testing practices is also carried out more than three dozen maturity assessments using digitized Frameworks and value stream map to Define
Jeroline
Roadmap child strategies for agile devops and Cloud transformation some of the use cases is implemented include automated user story reviews self-healing automation engines and
Jeroline
What enabled data provisioning with his wealth of knowledge and expertise we are confident that this session will be both informative and inspiring so without
Jeroline
Any further Ado let me hand it over to the speaker for today George
George
Yeah okay so today's topic is around digital testing especially uh with the focus around test automation so what you're going to do today is
George
You're actually going to take a look at how digital testing is different you're also going to take a look at some of the challenges
George
That you will be facing on a day-to-day basis while testing digital apps you'll also be taking a look at around 10 different Focus areas
George
Or maybe a checklist with around 10 different items which will actually help you to improve the way you deliver experience a digital experience to
George
Your customers so that is what the Azure does so let's move on uh to look at the focus area around digital so a simple
George
Definition of a digital app is it can be any software that can be run on a laptop or that can be accessed via laptop
George
Or a desktop or even a smartphone or even can be a kiosk can we actually call as a digital airplane issue you and the
George
Intention of building that app would have been to actually deliver information or content or it can be to sell a product or it can
George
Be maybe in order to deliver a service so this can be maybe a very simple definition of a digital app and folks who have
George
Been in testing for the last 10 or 15 years they would have got an opportunity to actually at least interact or at least work
George
In an application where there is non-digital kind of application it can be a test device application or even mainframes or as4 that kind of
George
Work softwares so you might be knowing that the way you actually test the digital app is very different from how you were you would
George
Have tested a desktop based app or a Mainframe kind of an app so let's look at how what the difference is for example most
George
Of these Digital Labs that you see whether it's an e-commerce website or maybe a Content media website everything is actually revolving around the need
George
For the business so you basically have a lot of competition and the needs of the business would actually change every day so it's very
George
Important for product teams or maybe for application teams to deliver applications faster to production so you'll have to quickly adapt to change and you
George
May very you may get very limited time to test some of your make many of your digital apps it's also important to provide a
George
Very good experience as well as personalized as well as effortless experience your customers personalization can be in terms of showing up products that the
George
Customer has bought in the past or it can be in terms of maybe showing content that the user refers to be anything of that
George
Sort which is very personalized based on a user's shopping pattern or usage patterns or at the same time you should also be making sure
George
That the the user or the actual consumer they're able to complete a customer's Journey or a business process without having any kind of trouble
George
And now since you actually have various standards uh maybe for accessing information now let's take an example of maybe a website like amazon.com you
George
Have a responsive website as well as a mobile app you can actually search for an item add it to your cart and maybe complete
George
The purchase on a mobile device and you should be actually delivering the same kind of experience the user should not feel a lot of
George
Difference between the responsive website and the mobile app so providing how many Channel experience is also another important Focus area since all of these
George
Digital apps are exposed to the internet there's a high stands that hackers can actually maybe look at attempting to actually hack into your system
George
So protecting your app as well as data is also very important when it comes to digital apps all of these apps can be actually
George
Used by maybe thousands of users or even millions of users and your entire business maybe maybe if you're a digital first kind of a
George
Company majority of your Revenue would be actually coming in from your digital library software it's very important to actually ensure that your applications are
George
Scalable as well as reliable brand is another important aspect you should be able to maintain a consistent brand identity across all your channels and
George
Also you should be actually looking at aspects like digital inclusiveness especially when you're actually trying to sell products or provide services to customers none
George
Of the digital product that we see today did not actually have a rating of 5 out of five when we started off or when
George
They started off so it is the the the experience and the quality is actually bought in over a period of time so it's very
George
Important to actually understand that fact and then look at continuously improve your experience as well as the quality of your apps by actually looking
George
At the usage pattern as well as the behavior pattern of your customers so these are ways in which the digital testing
George
Actually look at ways of implementing this up you are trying to actually test the digital lab you may actually come across many issues you
George
May not have enough what you say you may not have the right set of tools uh what do you say in your uh with
George
You to directly do the testing you may not you may be actually having very low levels of automation due to which you may not
George
Be able to deliver applications faster to Market you may be actually providing what do you say you may not be actually using metrics or
George
Maybe leveraging dashboards or insights to actually improve the way testing is done or you may not be actually you may be you may not
George
Be testing your workflows enough and you may be actually leaking in depicts to your production and as well as you may be actually delivering
George
A very poor customer experience many cases you may not have enough focus on non-functional testing including performance and security that actually leads to security
George
Breaches or data breaches or it can be actually slowed us that the customers may experience when they are actually using your app in production
George
So there are multiple challenges you may you might have faced all of these challenges already some of these challenges when you're actually testing digital
George
Apps during your what you call products and if you look at maybe a couple of areas there are 10 items that I'm actually going
George
To cover as part of the webinar today so we're probably looking at 10 different areas that or 10 different Focus items which can actually
George
Help you to improve the quality as well as experience that you're delivering to your customers and you can actually call it as a 10
George
Point framework that you can actually use in order to streamline your testing so you're actually going to take a look at the way better
George
Ways of doing maybe test design you're actually going to look at the ways the different ways of what you call uh they're carrying out
George
Test automation you're going to look at how to test for user experience you are going to take a look at how that you can
George
Actually do more of security testing as well as performance testing within your Sprints you're also going to take a look at numbers that you
George
Can actually improve the brand visibility as well as look at continuously improving your product by taking feedback on production so when I click go
George
On with the first item which is basically the model based testing of course so we are talking about digital apps so when you actually
George
When you're actually testing a different lab you're testing the app and there might be a lot of workflows better we have and there might
George
Be Workforce that may actually span across multiple other applications you may actually have interfacing applications or what you call a satellite applications which may
George
Have inbound or onboard interfaces so when you tackle tests for all of those workflows when you want to completely test your digital apps you're
George
Not just thinking of you're not just this thing maybe an e-commerce app you may be testing a pricing engine you might be testing a
George
Promotion engine you may be actually testing maybe an account management system you may be testing maybe a customer relationship management system with your membership
George
And things like that so it's not just like one system you will be having complex workflows that span across maybe 40 or 50 different
George
Applications that I've seen Workforce which may actually go all the way to maybe 250 steps so if you want to actually properly test those
George
Workflows and these workflows are something that can actually get you Revenue it can be a simple example of a business process or a workflow
George
Can be maybe onboarding a customer to a bank like a digital Bank through a website or maybe checking out an item and paying for
George
It during in an e-commerce websites all of these are actually tied to your business it can actually impact your quality of service or Revenue
George
If the workflows are not problems the best approach that we have seen in the past working is to basically use that approach called Model
George
Based testing design test cases so what you basically do using this approach is basically you actually go over and create a float or a
George
Business process model diagram that likely help you to understand the flow of information as well as the different kind of business schools that exist
George
Within your business process and you also know various the various conditions for example a business rule can actually have maybe a yes or no
George
What happens when the user is actually going ahead with a new Option or the yes option so you can you may actually have a
George
Primary approach you may have secondary pools as well as maybe error handling or workflow and if you actually use
George
Second thing is you can actually use these workflows to actually create test cases there are tools like broadcom Ard as well as this compost
George
That it can actually take the input like a workflow or a vpm and diagram and it can actually generate new test cases which actually
George
Test all the parts within your business process so you're actually saving you're actually improving your coverage you're actually looking at what you say reducing
George
The effort that is required for Desiring test cases and tomorrow if your workflow is changing you can very well go ahead and recreate your
George
Test cases by just updating the workflow so this approach is very impactful if you're dealing with complex workflows whether it is banking retail health
George
Insurance or any other domain and it actually saves you a lot of time and it actually helps you to generate the most optimal number
George
Of test cases that it might be required for your project or for your program the second important approach that or second important aspect that
George
You should be looking at when you are dealing with the digital application is definitely if you want it seems free to Market you definitely
George
Need to look at automation the automation can be targeted around apis it can be targeted around your workflows or TV what you call as
George
UI based just the automation scripts it can be testing your complete business processes it's getting any of those and there are multiple ways of
George
Actually doing test Automation and an approach that works for B may not actually work for you so every organization may be different there are
George
A lot of parameters that actually cause indirectly maybe impact the way you do actually the way you actually decide upon doing test automation or
George
The approach that you need to select for test automation is governed by a lot of parameters but let's actually take a look at what
George
Are the four options that you have for maybe carrying out test automation of an application one is basically you can actually go out with
George
Maybe a scripted approach you can either go with the tool set which is basically open source like maybe selenium or RPM or you can
George
Actually go with the UFT or a test complete solution where you may have a little bit of scripting and then decide to automate your
George
UI as well as API test the second approach is you don't you can actually go with the codeless two or skip plus two maybe
George
Like off key for example and you can actually use a tool like or key directly automate your test you don't have to write any
George
Kind of script it is very straightforward you can actually go and create tests for your package applications or for your digital applications and then
George
Execute it you're saying maybe a big cloud is digital form or a browser form or a device form the third approach is your organization
George
Might have invested in RP you may actually decide to use an RPA to directly carry out automation if you're dealing with e-commerce or even
George
Maybe Hardware devices for automation you may have to actually even use robotics as well as robots or as well as microcontrollers to actually automate
George
Your testing so the approved that you may actually select or decide upon should be happy on any couple of parameters so all of these
George
Approaches may not be required to maybe stick on to maybe one approach in some cases but I think it's very important decide upon one
George
Single approach if you're actually looking at automating your digital application assets one aspect that you can definitely look at is basically do I have
George
The required skill sets for example today if I'm deciding to go go ahead with the scripted approach do I have enough Engineers but then
George
My organization can actually do scripting and automate my test will they be able to do uh execution as well as maintain these groups on
George
An ongoing basis is the scripted technology that I'm going to use is it going to support all my technology needs I may have maybe
George
Desktop based applications I may be still using Legacy and they have mobile applications microservices and all of those but it's about all my technologies
George
Have I already made investments in test Automation and if I'm you have not been Investments is there an appetite to actually invest in Foods
George
Or should I stick on to the open source what do you call Stacks so there's a lot of parameters
George
Automation organization don't go with what your friends have done or what your neighbors have done you should be actually taking a look at your
George
Organization and then selecting the right approach and if you don't select the right approach you may not actually get the required investment or required
George
Returns from the Investments that you make from test automation
George
Now moving on to point number three so it's very important to actually provide feedback to your development teams why because in in today's world
George
We are actually dealing with friends that are two weeks or three weeks you may be maybe getting a bill maybe in the second day
George
And you should not be actually doing testing for one and a half weeks and then providing a list of books to your developers it's
George
Very important for testers to actually provide feedback on a daily basis that means you should be actually executing your test on a daily build
George
You should be actually running both your functional tests as well as non-function requests you might not be running maybe 100 of your test if
George
You should be at least in selecting a subset of your test and then running it so that you can actually provide a list of
George
Box to your development team on a daily basis and then they can start fixing it if you keep your testing to the last few
George
Days of your Sprint there's a good stance that none of your uses stories they actually have a done status towards the end of your
George
Screen because they might be open difference between the development team may not be able to fix it and if you want to integrate your
George
Test with the devops pipeline maybe you'll be the tool like Azure devops or with Jenkins or maybe a gitlab kind of what you call
George
Devops platform it's very important to actually have a good amount of collaboration with your development infrastructure as well as devopsy so you definitely need
George
A better collaboration ways of working with these teams if you want to actually Implement uh devops enabled what you call testing or a continuous
George
Testing within your organization but it's very important there's no point in actually doing what you call test towards the end of your spread even
George
If we have seen a lot of organizations that would actually just test automated test negative towards the end of the screen does it make
George
Sense you should be definitely using or leveraging the power of devops to actually provide feedback to your developers on a regular basis the other
George
Important aspect especially when you're dealing with browser-based as well as what is the mobile apps which are basically native is basically duplicate compatibility testing
George
So you may have to run your test maybe a chrome maybe seven different browsers and 30 different devices and you should definitely look at
George
Doing a large scale execution in a parallel and distributed mode if you want to actually complete your automation test Cycles on time otherwise you
George
May be running your tests for days together to complete the validation all these devices and browser combination it was very important to actually use
George
Latest Technologies you can actually run your test in cloud or you can actually run a good amount of your test Maybe by spinning up
George
Docker instances so you should actually liberating all the latest Technologies especially device forms browser forms which are actually public uh what do you call
George
Public hosted for example D cloud is a good example big Audi provides both browser-based forms as well as devices on which you can actually
George
Run your test so you can integrate your framework with the peak Audi platform and then run your test on that platform or if you
George
Want to run it maybe on a cloud machine you can actually have multiple instances being set up and then you can run your test
George
On that or you can actually have an on-prem infrastructure on which you can actually set up Docker instances and run your tests and then
George
The other thing is you should not be running tests and sequential mode you should be able to run tests in a parallel sort of
George
Distributed mode so that you can actually complete your test cycle sometimes the next important point is around performance so when it comes to uh
George
What do you say digital apps as we are talking about two to three weeks print you can't actually leave your performance testing towards the
George
End when you're actually having a hardening screen or a release level spread it's very important for you to actually provide feedback and what application
George
Performance to your developers already in the life cycle so you can actually start off with smaller tests you can actually start off with maybe
George
A performance testing of your apis maybe you can actually do a feature level test and then pass on that feedback to your developers it
George
Is not server-side test server-side tests are very important you need to ensure that your server doesn't give you memory leaks the CPU utilization is
George
Under control all of those things are actually required but at the same time it's also important to focus around client-side performance so you should
George
Also you should also make sure that your apps are actually downloading or your apps are actually throwing up screens maybe in two to three
George
Seconds of time you can actually look at maybe the the information that's coming in how much time is it taking for the Maybe
George
So all of those things should be actually considered one aspect is basically users don't have a lot of patience when they're actually using these
George
Kind of digital apps there's a lot of competition they have better apps to actually go after so it's very important to actually look at
George
Both server side as well as client-side performance and then as a part of a device you should also be integrating your test with your
George
Devops pipeline maybe you can actually run your test maybe if your full workload is 100 users at least you can run it with 25
George
Users initially as part of your daily Builder and provide the feedback and maybe towards the end of your release or on a week label
George
You can actually go and run your test maybe with a code load so it's very important to even pass on feedback to your development
George
Team around performance as well the next important aspect is around security
George
So we look at security the traditional practice of security has been to actually carry out security testing towards the end of the release where
George
We actually use a commercial tool or an open source tool to run a code scan you basically do something like a static application security
George
Test and then soon after that you may actually even do a dynamic application security test or a network prerection so all of those things
George
Are basically sequential test that's done towards the end and many from my experience what I've seen is like you have seen projects getting delayed
George
Because you actually have a number of flaws that are actually detected towards the end of your project and developers really struggle to fix most
George
Of those issues civility one and two issues and a project deadline goes for a cross so the primary issue there is they're actually doing
George
This towards the end and now we should also look at the team who's actually doing so you may have a dedicated set of Engineers
George
Uh who are part of maybe a security team who are and who are actually deployed to actually test your particular maybe a sales Services
George
Team and they may not have enough bandwidth to actually test your apps so you basically wait for their time to actually get the get
George
Their reports and even after you fix your difficult you may have to work you may have to wait for days to actually get their
George
Time of these tests so the very old method of doing things in today's world as you are talking about uh the need for quickly
George
Adapting uh towards the the change from based on the business needs it's very important to actually carry out everything in a much faster mode
George
The first thing is very important to actually look at implementing that Secaucus practices and also look at indicating your development team around secure coding
George
Practices because it takes a lot of time to fix so preventive actions are much better than corrective action so as a preventive measure basically
George
Educate your development team on secure coding practices give them guidelines so that the code quality is better and you don't actually get a lot
George
Of issues when you're actually going ahead and doing a code level scan the second important aspect is it requires a mind shift change every
George
Organization is used to having a security team and now when you actually move towards a model where everyone is responsible for security or if
George
You're actually going into the devsecups kind of a model it becomes very important that everyone contributes towards it there should be a contribution from
George
The developer team there should be held that needs to be taken from your security team you may also have to work with your devops
George
Team to actually integrate your pipeline so because the government cultural shift as well as mindset mindset ship if you want to actually implement the
George
Livestock of practices and you can actually implement a baby various different types of scans or various types of scan it can be basically to
George
Look at maybe something like a composition analysis or software composition analysis basically done to see the dependency on third party libraries I think most
George
Of you have heard about the recent work that came into our GPT the primary Library having an issue we are actually using third-party libraries
George
You may also have a risk of actually exposing information a because of issue that is actually there in that Library so it's very important
George
To understand the libraries that you're using and then do a software composition analysis
George
You may also have to look at the code quality and then find out security costs you may have to do static application security testing
George
You may have to actually do Dynamic tests in order to find out whether your application is prone to maybe cross-size scripting as well as
George
A SQL injection so it's possible to integrate all your all of your all of these scans uh to your devops pipeline and then look
George
At maybe doing it a very hands-free so if once your development developer checks in the code your devops pipeline will get triggered any directly
George
Scan all of these things and actually give you a report telling that there are X number of issues being reported across these various spaces
George
Of your pipeline or various stages of your pipeline It's very effective and it may take some time for you to implement it initially but
George
But it was implemented for a program or for a product you can actually use it for a prolong time it's very important to actually
George
Look at user experience and user experience is not again something that you should be actually doing or looking at when you're actually nearing your
George
Release or towards the end of the release you'll actually think about having uh what you call a user experience just being done now user
George
Experience or testers are actually responsible or testers who are actually part of the program or a part of an application developer to likely get
George
Engaged with user experience right from the beginning of the product so you may be you may actually get an opportunity you want to work
George
With ux researchers the U.S researchers may actually be talking to your customers they may be calling customer groups but they're actually part of those
George
Discussions but I've seen a lot of inputs coming in from those meetings the U.S researchers might have with their business team or with your
George
Daily users you may really you may actually understand what the pain points of your users are you may understand what they're looking for you
George
May actually understand the different personas that may be using your product you only actually understanding what kind of solutions that they are looking at
George
And all of these inputs can be actually taken to write your test scenarios as well as test cases it's also important to actually test
George
Or get feedback about your application by actually using maybe low Fidelity or High Fidelity kind of prototypes so there are various techniques that can
George
Be used even testers can actually take these prototypes and then show to users and get feedback you can also do something like click free
George
Testing creating heat maps and all of those things to actually see what the users will be actually doing when they actually see the screen
George
So you can actually find out where the user might click or the areas where the user might be actually moving their mouse or you
George
Can actually see card sorting or techniques like card spot sorting to understand how the user would actually access a particular workflow how they actually
George
Complete the tasks and what are the steps that they might take based on card sorting so there are various ways in which you can
George
Actually get the feedback from the user you don't have to report everything as a bug towards the end you can get this feedback and
George
Then use this feedback to actually improve your product right from the beginning so if you'll be actually applying a shift principle here as well
George
To actually provide feedback to your uh what do you say your development team as well as to your ux engineers on the product and
George
Once your product is ready you can definitely test do one level of testing but it's also important to actually make sure that you actually
George
Get a third party or maybe talk to a set of people or very much who are not actually part of your program or product
George
And then get feedback Tau Source testing is a very good technique for it you can actually get feedback from a large setup for what
George
You call audience and you may actually get a lot of issues related to compatibility usability and ux when actually doing crowdsource testing It's very
George
Effective you can actually get the results in a couple of days then you can actually get maybe a bunch of issues even before your
George
Product is actually from the from your maybe from your prospects even if your product is actually before your product they will ship to them
George
So it's also such thing as another techniques all of these techniques will definitely help you to improve your own experience that you're actually delivering
George
To your customers the other important aspect so this is one aspect which I often gets for water so there are a set of people
George
Uh who actually have some kind of disability can be a disability in terms of maybe color blindness we can emotion or physical kind of
George
Disability and when you're developing a digital library with a website or if you're actually dealing with something like even a native app it is
George
Very important for you to actually make sure that these apps are actually accessible for everyone so it's very important to actually include everyone whether
George
Whether you're having an able person or a different level person it's very important for you to actually look at providing or giving your app
George
Digitally inclusive why because one maybe reactive six people one of them can be one of top six can be a different label person and
George
Yeah actually a 1.3 billion people in today's world uh who are actually having some form of disability so it's very important to actually provide
George
But you say answers to the to the to the folks who are differently able as well so if you have any designing and have
George
You should make sure that actually works for their Master because if I click onto they were not able to access your service they were
George
Not able to buy your products or they may not be able to access your content if you're not actually making it accessibility or digital
George
Uh digitally inclusive so how do you enable it so there are various standards against which you can actually do testing so there are I
George
Would say like wcig 2.1 web content accessibility guideline 2.1 is one of the popular standards against this you can actually test your app so
George
There are 13 different guidelines and I think around 78 different success criteria that are available as product 2.1 you have to initially decide what
George
Is that you're going to satisfy so these 78 success criterias can be broken down into the three different conformance levels like a double A
George
And AAA many of the organizations may decide to actually provide any uh
George
So you may have to decide that and then start testing your app maybe during as soon as it is ready for a digital uh
George
Inclusiveness as well as our assets so there are multiple tools these is one of the most popular tools they have a framework called acts
George
That we've already integrated with one of our existing Frameworks you can actually conduct these assets upfront and then give that feedback to your developer
George
That this app is actually having issues it is not basically inclusive or exactly having non-conformance with the wcag standards
George
Automated test uh some of the some of the ideas would include like for example every email should actually have an alternate place which can
George
Be definitely verified using an automated tool but the alternate takes whether it is actually matching with what you see on the screen may not
George
Be something that you may be able to what do you say uh judge or you may be able to validate using automated so you
George
Have to go with a semi-automated kind of approach will be 40 of the items that are related wcag can be actually validated uh using
George
Uh maybe an automated tool whereas the remaining 60 percent may require manual verification it's very important to keep this in mind 100 automation cannot
George
Be it is also important to actually get feedback from folks or differently able you can work with ngos or you can actually include them
George
As part of your user experience focus groups and then give the feedback on what they feel on your product are they able to use
George
It or are they finding some kind of challenges when they're using it is very important because you're actually losing on a good amount of
George
Your audience or good amount of your customers because your app is not the accessible friendly but it doesn't take a lot of time again
George
Training your development team on standards might be required but it doesn't take a lot of time to train and then make your apps digital
George
20 or what do you say accessible trend the last point that I have was around improving second last point that I have was around
George
Improving the brand disability so it's very important maintain consistency in your brand whether you're actually dealing with a mobile app as well as a
George
Mobile kiosk or a kiosk or a website so you need actually maintain your brand guidelines and all of those things you should also look
George
At the quality of content that is available in your landing pages in your blogs or it can be inside your product pages so quality
George
Of product is very important you should also make sure that your content is actually accessible you can someone is searching for a product or
George
Someone searching for your service is it coming up to the first few pages of Google search very important make sure that the right keywords
George
Are being used so test there are multiple tools like AHS moss and all of those tools that can actually get you this information but
George
Testers also needs to actually open on these areas so I've not seen a lot of testers focusing around SEO but it's very important to
George
Make sure that the content quality is actually maintained so testers need to spend time on validating the quality of content the other area where
George
Tesla needs to focus is you should also look at why a company doesn't operate so are the competitors using better keywords uh is the
George
Quality of their content better than what we are offering are they actually getting a better search ranking than us so it's very important to
George
Compare your website using SEO tools that the competitors and then see how good that you can actually do better and then testers also can
George
Actually contribute towards technical SEO in the sense like if you do technical SEO you can actually get a better search ranking for your website
George
This includes maybe creating backlinks backlinks are nothing but you're actually referring to your website maybe from a blog or maybe from an article that
George
You're placed in someone's else website or technically SEO can also include broken links so Aria website actually having broken link so it's tested responsible
George
To make sure that there are no broken links so you may have to you should be able to run a scanner then point out
George
What all pages are not as or you should also make sure that whether your pages are getting indexed so every time you actually update
George
A create new content it's a tester responsible to go and find out whether the content is available or whether the content is actually updated
George
And whether the site map is actually updated so that directly comes up with the search engine so it's very important to make sure that
George
Your content is what you call searchable and it is available at the top or maybe a search results when you're actually doing a search
George
In Google or through a search engine like bit and it's very important for testers to contribute towards the SEO activity you cannot just leave
George
It to your marketing team or your technical team to handle it the testers also needs to play a very important role to actually improve
George
The quality of content as well as in arcade enabling technically the last point is around continuous quality so here so once you're as I
George
Was mentioning earlier no app will actually get five out of five rating on day one so you have a definitely look at improving your
George
App over a period of time so there are various ways in which you can actually improve your uh what is basically looking at what
George
Your customers are talking about your product so this is basically what we call as customer feedback analysis customers maybe writing maybe good comments as
George
Far as nasty comments about your product or service maybe in an app store or maybe in social media so if you're actually having a
George
Mechanism using which you can actually scan through those comments analyze it and then generate meaningful insights there are tools that actually helps you do
George
The tickets or production tickets are also a very good source of information for you to actually understand how your customers what kind of problems
George
Your customers are actually facing so the customer feedback analysis both from a sentiment as well as from the active feedback you know I actually
George
Get a lot of understanding on the pain points of the customers and what is going well and what are not going well with your
George
Product or service and you should be actually using that feedback to improve your overall product now the second area where you can actually focus
George
Is around to understand how customers are using your product uh for example I am actually using maybe I'm having a website so I can
George
Actually go and find out whether my customers are actually accessing my website or what percentage of my customers are actually accessing my website maybe
George
From a Chrome browser so how does it help me tomorrow if I'm actually if I'm if I if I get to know the 95
George
Percent of my customers are using Chrome I would actually put many my maximum Focus around maybe my testing for my next series against Co
George
Compared with any other browser because I know that 95 considered by customers are on Pro and if I'm actually able to do a good
George
Job around satisfying them I'm actually in a will be in a better report so there's a lot of insights that you can actually generate
George
Using a web analytics to maybe a tool like Google analytics and this information is going to be very useful for you to actually decide
George
Upon the areas that you can test or maybe the browser or device combination that is
George
And these two information uh these two inferences that you get both to customer feedback as well as from a usage pattern analysis should be
George
Actually used to improve your product so how do you improve next time when you're actually testing your product or when I'm actually testing my
George
Release I should be actually having a test strategy that accommodates the inputs that I've got from both the customers as well as on these
George
Analytics that I've been able to derive from my website of my digital app so this is again one more way of improving your product
George
So basically we're continuously improving monitoring the quality as well as taking that feedback and improving your overall product so this these are maybe the
George
10 different items or 10 different maybe Focus areas that can definitely help you to test your applications faster you can definitely provide a better
George
User experience you can even cut down on your costs because you're actually finding defects early in the life cycle so it definitely requires all
George
Of you to at least Implement some of these practices in your project and then also inform me on the results that is so now
Jeroline
The code is actually open both questions uh I see few questions for you George uh here's one so what are some of the limitations
George
Of using Dockers for browser testing okay so basically uh Dockers are good but if you're actually trying to test on every maybe 10 or
George
15 different versions of a browser for example you want to test on your five different versions of Firefox and maybe like uh six different
George
Versions of maybe Safari so we need to actually set up the infrastructure with all these versions so it might be a bit uh tough
George
To actually set up the infrastructure as well as maintain it and tomorrow when you're actually having a new version of your browser you may
George
Need to actually have a Docker instance that actually uh that should be actually set up and that should be actually used to actually validate
George
Your product but if you're actually having maybe only a couple of browsers Dockers would actually work with and now if you want to test
George
The actual performance of your application on the browser of your actual client-side performance testing but also may not be a good option because you
George
May not get the real experience on a Docker instance compared with how it would actually behave on a real browser which is actually installed
George
On a laptop or on a desktop so performance testing wise also you may actually face a bit of challenges but if you're actually doing
George
Small scale testing maybe it's a couple of processes then we talk it as a good option so these are the two important these are
George
The two areas that where I can actually find maybe a couple of challenges it comes to doctors
Jeroline
Uh here's one more question for you so what are some of the usage analytics metrics that a tester should be analyzing
George
Okay so there are various metrics for example if you're actually looking at maybe Google analytics or if you're actually looking at a web server
George
Log there's wealth of information that you can actually get from it for example you can actually find out how much of your customers are
George
Actually a returning for example if I a 50 customer that's using my website today are they actually coming back to my website which actually
George
Shows there is something some some problem people are not happy with their website that's the reason why they're not returned the other important information
George
That you can actually find out is are users having what kind of browsers are my users uh what you call using when they're asking
George
My website what kind of screen resolutions do they have from where are they accessing the website from which part of the world are they
George
Accessing it what pages of my applications are actually being accessed and if you're actually having some kind of custom code or scripture you can
George
Even find out the workforce that are used quite the most by your uh for your end Customs so there are there are and then
George
Maybe you can also look at screen resolution so as especially maybe from this information you can definitely look at the focus areas for your
George
Testing in terms of deciding upon what screen resolutions are my customers using what pages are they used the most where are customers dropping out
George
Which pages from which all pages are the customers dropping are they sure that there's a problem with that page and you need to actually
George
Do additional testing or you should give that feedback your development you can decide upon the mobile devices and your customers are using and sort
George
Of they always spread so are my users assessing my app maybe from IOS alone or maybe there's a good amount of users who are
George
Actually using maybe Android uh for accessing my app so all of the information can be used and you can really optimize your testing so
George
You don't have to spend a lot of fresh time testing your apps on every browser and every device neither what you can do is
George
You can actually maybe the most important directly using scientific data as per as the usage data and then deciding upon a strategy rather than
George
Making assumptions so that that is what I would actually say nothing it has been I've found is very very useful in terms of when
George
You say improving your product as well as on cutting down on the efforts that you might be spending on
Jeroline
Okay here's one more question for you judge so what role do do you think uh artificial intelligence and machine learning play in digital testing
Jeroline
And Automation and uh how do you think organizations can leverage these Technologies to uh improve their testing process in general okay
George
So when it comes to digital you can actually look at using AI in multiple ways so maybe if you look at maybe something like
George
The same topic that we discussed usage feedback analysis or the customer feedback analysis so you can actually use AI to actually analyze or NLP
George
To analyze the customer feedback then understand or generate insights from the customer feedback that has been actually provided by your customers it can be
George
A set of comments that they've written in app store or it can be a set of comments that they have actually written inside maybe
George
A social Media Forum like filter or Facebook that's right the second area where you can actually do better is maybe look at the Technologies
George
Like self healing for example if you're actually looking at reducing correctly having changes to your app very frequently now the good sense that your
George
Application your automation skills might fail when you're trying to run it across your regression cycle so what you can actually do is basically correctly
George
Trying to use a tool itself feeling kind of capabilities you can actually use those capabilities in order to reduce the test they're pretty another
George
Use case now there are tools that that you can actually use in order to even generate tests for example you're testing apis or Iraqi
George
Testing maybe uh what do you say respray services so what you can do is there are tools that can actually look at your APA
George
And applications that you might have stored in maybe a tool like swag and then Auto generate test s so there are a lot of
George
Tools that are currently available in the market that actually helps you to improve or reduce your test design report as well as being transfer
George
Now and also you can also use things like what I'm saying like customer service and Analysis to actually look at improving the way you
George
Do testing and then from a user experience standpoints there are multiple tools that we have used in the past that can actually look at
George
The actual emotion of a user when he or she is actually using your app for example it can be basically looking at the patient
George
Recognition techniques and then finding out and using emotional detection algorithms to actually find out the actual emotion of a user when he or she
George
Is actually using up or there are tools that we have a test analytics capabilities in the market now what this tool does is for
George
Example I'm actually having a setup uh I would say like a test case for example I am having 15 000 tests then I should
George
Be actually that I've actually created for my application so tomorrow in a developer is actually giving you a build for testing you really don't
George
Know what the developers actually changed and you can actually end up running all the 15 000 tests on your digital app thinking that there
George
Might be something impact because the developer has actually done something now there are tools that actually have capabilities using which you can actually run
George
Tests based on an analysis an impact analysis so what the tool basically does is analytics based on what the integration they actually look at
George
The the new version of the app that has been released for testing and if they basically look at running a scan on that particular
George
App and then it actually tells you the number of tests that you may need to write newly because there's a new code new set
George
Of code that has been added by your developers and there are lines of code that have been modified or removed by your developer so
George
What it tells you is basically you may have to write maybe 50 new tests
George
To validate your app so you're actually cutting down on your time at the same time you're not actually taking a risk what you're doing
George
Is you're basically using this data in order to so AI can definitely improve improve the productivity of test design and maintenance it can also
George
Help you to improve the quality of your products it can help you to improve user experience it can also improve your content on your
George
Cost of testing by actually following by using techniques like impact analysis and test analytics so in various use cases but a has not reached
George
A stage where you can replace clusters maybe half a decade or so to get to that level where test AI can actually take our
George
Testing maybe something like a chance GPT for testing maybe something of that sort May commit maybe in a decade or maybe half a decade
George
So but we are not there yet but yeah we should definitely explore the possibilities of using Ai and you can actually do wonders whether
George
You're tracking testing a digital app or a non-digit lab
Jeroline
Uh there's one more question judge uh from nagaraja so he's asked you to share some test strategy for microservices
George
So I think most of the testing that you do I think other than contract testing so you definitely been doing contract testing if you're
George
Actually dealing with microservices in some cases the contract testing is actually done by your developers but if you are not if your developers are
George
Not doing contract based testing you should be definitely using tools like Pac to actually do contract level testing and then you can actually or
George
If your developers are doing maybe contact level tests you can actually use maybe uh what is the rest assured kind of tool to test
George
The API portion so you should be definitely testing your apis with multiple data incomes to make sure that it actually serves the purpose and
George
That's very important so contact based this thing and it's easy the special thing the special type of testing that you may do on a
George
Micro service you actually make sure that they can they are actually having required capabilities as far as it can it can be actually integrated
George
With the rest of the services and and I think otherwise it's mostly the rest based testing that you want the study that you may
George
Actually be adopting for testing apis can be adopted to microservices there are a couple of other types of testing like contracts
Jeroline
In terms of micro services there's one more question Josh uh can internal crowdsource testing help in improving the quality of digital applications
George
Okay so uh it it depends uh for example when you're actually dealing if you're actually dealing maybe with an app that is going to
George
Be used by employer I assume that you're actually working in a company in an organization maybe with 10 000 users and you're actually trying
George
To release an app or maybe for maybe for maybe something like a bot that can actually help you to get your query the answer
George
It depends of sending a mail to the helpless rather than you're actually going to use a bot uh maybe a chat board that you
George
Can actually have answer queries so in that case your audience is only having 10 000 uses it might make sense to actually select maybe
George
A few users from your internal code or internal or organization and then use them for testing this app that you build for this it
George
Makes perfect sense in some cases uh if your organization is small and you can actually maybe or even if you even if you're having
George
A large organization you're working with a services-based organization between them twice and if you want to do crowdsource testing of your apps for your
George
Customers definitely possible what you can do boost you can actually select people who are not working as part of this product select maybe set
George
Up a crowdsource testing platform and then have testers and test these apps and then provide feedback to your product team but you may have
George
To avoid your testers if you don't want to agree if you want to actually get the required results so definitely it is possible I've
George
Done that in the past it is is very small maybe you only have maybe a couple of employees maybe 100 employee company you may
George
Not get enough participation from your account because all of them are busy then indirect also is testing you're not actually work but even if
George
You if you're working in another organization if you don't have proper reward mechanism and recognition uh for testers councils testing or actually pay or
George
Internal councils testing would actually pay because we don't get enough participation levels and time from your testers you're likely going to get that Diversified
George
What you call feedback especially around the user experience and compatibility from your users especially when you're doing counselors testing or if you're dealing with
George
A mobile app the most important aspect that you'd be actually looking to harvest basically look at whether my mobile app can actually work on
George
Multiple different devices but if you're not having you know participants you may not be able to get the required results so it's very important
George
To actually reward your employees but otherwise if you if you want to do a large scale testing if you want to get feedback maybe
George
From 1000 users or both we definitely have to go with external trousers existing platforms to some extent data accounts this thing would actually help
George
Depending on the app as well as the user base and the actual purpose whether it's validating user experience or maybe validating the compatibility depending
George
On your objective you can actually expect the results of the required outcomes
Jeroline
Okay so here's another question so when it comes to digital lab testing how do you determine whether to opt for an on-premises solution or
George
A private Cloud option okay it's a very tough uh top uh question it's very tough to determine what would actually work say various Solutions
George
Right you can actually go out with a physical lab or physical set of devices maybe like uh this boosts work well maybe when three
George
Years before when everyone was actually working in from a single office everyone used to work from office there are no remote working or you
George
Work from home options available so it might make sense to actually buy maybe a couple of devices and then testing on those physical device
George
But in today's world in the last two two to three years one thing that you have seen is like we have Acura satellite offices
George
We have good there are companies who are completely virtual there are companies where we actually have hybrid modes of working so you may if
George
Even if you're if you're testing a mobile app if you want to test your website on multiple browsers you may be you may actually
George
Find it difficult to get all the required device models or even if you're actually having devices at office it may not be possible for
George
Everyone who's working remotely to actually access these devices and at the same time you cannot buy all these devices for each of your efforts
George
Or engineer so it's very tough to actually access devices from their home so maybe a platform for accessing devices can actually help you there
George
And now you have two options whether you should actually go with a private Cloud option private and sense like the devices are only accessible
George
For your organization you may decide to actually set up a platform like be cloudy which provides your private Cloud option and then set up
George
Maybe 35 or 40 different devices and only employees are actually working for your organization or testers or developers are part of your organization can
George
Actually go ahead and Associate each of these devices so it's it's what what you may also have to keep in mind that you may
George
Need to keep refreshing your devices every now and then in the sense like if you if there's a new device coming into the market
George
Tomorrow is iPhone 15 iPhone 16 you may need to actually upgrade your device lab or your private attack those devices and many of the
George
Cases there might be uh when you set up the lab itself you may decide upon the refresh frequency of the device but the advantage
George
That they get there with those options you can actually get your tester will be able to access these devices 24.7 the dedicated to viewers
George
And but you may actually have maybe like only maybe uh two or three dozen devices available for you now there's another option which is
George
Public Cloud where it can be very cost effective but you may have maybe like thousands of mobile device models available and there might be
George
Like 10 000 users also are trying to actually use these thousand device models
George
But you actually have well maybe a very fast collection of devices both Android and iOS devices available in the cloud so the approach that
George
We have seen what a hybrid approach 90 of your testing on a private cloud map which is exclusively built for you and if there
George
Are special devices on which you need to run your test you can actually go and run it on a maybe a public Cloud so
George
You can actually go with a hybrid option where you invest in a private Cloud lab or your organization and then any devices or any
George
Kind of maybe box that you want to read test on a specific device exactly as a public device solution
George
This is the best option I would actually recommend going out with a physical set of devices because it actually has its own problems you
George
Will not be able to maintain it you don't have any kind of control and your remote employees or employees working from a different office
Jeroline
Location may not be able to access these devices uh here's one more question judge so what tools would you use for testing chatbot
George
Okay so there are different solutions even you can actually build uh what you say a solution using selenium uh with a couple of libraries
George
Of python you can actually very well use those kind of solutions uh Solutions like UI paths can also help you directly test the chatbot
George
But the most important thing that you need to realize when it comes to chatbot testing is it's all about understanding the intent of your
George
Uh what do you say the question that your customer is asking so you need to actually have some kind of intent capability in the
George
Sense like you should be able to generate intents to test your chat parts and there are tools that are specifically designed for I think
George
The best tool that I've seen uh for testing chatbots is a tool called bot tape which actually helps you to test both the intent
George
The functional aspects the error handling scenarios and all of those aspects so from a chatbot testing standpoint maybe there are a couple of things
George
That you need to keep in mind in your testing as well as definitely functionality it should actually give you accurate results for whatever asking
George
You should be able to handle errors if you're not able to find an answer for a question should actually be able to gracefully exit
George
And then tell what it was sorry I'm not able to get this information it should be actually having a personalized but you continue to
George
Give a personalized experience you should be actually interested you by name you should be greeting you the personalization very important it should be definitely
George
Having better responses in the sense like speed is very important uh when it comes to what you call chatbot so and you should also
George
Be able to when you call scale depending on the number of users that might uh that might be accessing the chatbot but if you
George
Go to validate maybe like 80 percent of these features I would say bottom is the best tool but if you want to just validate
George
The intent as well as a functional aspect you can actually develop a custom solution Maybe by using Python and selenium that can actually help
Jeroline
You to validate the behavior all right uh so looks like we are out of time for today's session uh thank you so much Josh
Jeroline
For that insightful presentation on uh revolutionizing digital testing using test Automation and for Patiently answering uh the questions from the audience uh so Before
Jeroline
We Say Goodbye remember that uh we'll send out a recording of This webinar to all the attendees so feel free to watch it again
Jeroline
Or share it with your friends and colleagues and if you have more questions no worries you can reach out to us directly uh through
Jeroline
Uh our socials or email IDs and we'll get those questions answered for you and a big thank you to the audience uh from both
Jeroline
Be cloudy and test house uh Team for joining us today we really hope you enjoyed uh today's webinar and learn something new so stay
Jeroline
Tuned for future events and collaborations between Peak cloudy and test house and thanks again for being with us today and have a an awesome
Jeroline
Day ahead we'll see you at our next event thank you thank you bye-bye
