Dinakar
All right hello everyone and welcome to the first webinar on the change leader series break free uh my name is dinaka i'll be the
Dinakar
Host for today and before we get started i would like to go over a few housekeeping rules
Dinakar
So your line is currently muted however you can submit your questions during the webinar through the chat option at the bottom of the screen
Dinakar
We will answer your questions as part of the q a section at the end of the webinar and please note that this webinar is
Dinakar
Being recorded and we will send the link of the recording to share with your colleagues later uh with that said uh let me quickly
Dinakar
Share a bit about the series uh on this next slide you will see what the idea behind breakthrough was and breakthrough was there was
Dinakar
An idea that birthed out of the need for change in the testing domain we have seen the testing industry evolve over the decades as
Dinakar
A few leaders took the risk and embraced change and you know somehow we knew that you know we believe that this change can be
Dinakar
Accelerated at a much faster pace and so we took the liberty of identifying and inviting a few leaders who are breaking the mold and
Dinakar
Erasing change to see if the qa industry evolve and a few leaders that you will be witnessing are uh you know right up on
Dinakar
Your screen uh priya talker is one of them uh who will be speaking later on uh during our session and uh you know and
Dinakar
This is what became the starting of the breakthrough leader series our hope is that these sessions would spark ideas in each of you to
Dinakar
Be the change in the qa industry we want to see the qa industry improve and grow in leaps and bounds with that let me
Dinakar
Welcome our first change leader priya taylker priya has over 16 years of experience in testing and various domains such as device testing mobile application
Dinakar
Testing uh quality engineering product management and user experience her primary experience has been in the field of mobile device and application testing with companies
Dinakar
Like benq lnt technology service capgemini and eaton in her free time you can see her in grossland books as she loves reading and enjoying
Dinakar
Books without further ado let me hand it over to our speaker priya taylker
Priya Telkar
Thank you thank you so much for the introduction and hope i'm audible can you just confirm if i'm audible and
Priya Telkar
Yes we can hear you loud and clear yeah thank you so much for the introduction and thanks uh for giving me this opportunity i'm
Priya Telkar
Glad to be part of the break free session where uh we're coming together as a community to share ideas discuss what we have learned
Priya Telkar
So far what is happening in the industry and how we can bring about a change
Priya Telkar
So the topic for today is how qa is evolving in devops and how qa can be largely integrated in devops with a mindset that
Priya Telkar
Is required to fit into the culture of devops right so agenda for today is simple now we'll understand we'll just give a brief brief
Priya Telkar
Overview of what devops is how testing and devops work together why testing is needed in devops what are the driving factors what is continuous
Priya Telkar
Testing and what are the factors that influence continuous testing how does or what is the role of automation in continuous testing and devops test
Priya Telkar
Strategy as well so to begin with to set context of uh what devops is all about if we were to talk about 20 years
Priya Telkar
Ago uh like watching a movie on demand on a cell phone or um the idea of connecting anybody anywhere in the globe at any
Priya Telkar
Point of time making transactions online shopping online was not possible because either technology was evolving or technology wasn't just there today it is business
Priya Telkar
As usual now technology has come a long way since the early days of computers driven by vacuum tubes and software programs return on punch
Priya Telkar
Cards this dramatic growth is due not only to the accelerating rate of hardware and software innovation but to the modernization of organizational process that
Priya Telkar
Fosters such innovation and one of the most important advancement in those process has been the devops movement devops as the name implies is a
Priya Telkar
Collaboration of development and operation team members the fundamental premise of devops is to combine all those associated with delivering a software product into a
Priya Telkar
Unified self-direct self-directed and self-correcting team that follows agile as its work process now devops isn't a process technology or a standard but it is
Priya Telkar
A culture a culture that has brought about a great change in the way we develop and
Priya Telkar
Develop software right so as amazon defined devops is a combination of cultural philosophies practices and tools that increases an organization's ability to deliver application
Priya Telkar
And services at high velocity evolving and improving products at a faster pace than organization using traditional software development and infrastructure management process this speed
Priya Telkar
Enables organization to better serve the customers and compete more effectively in the market so now under the devops model development and operation teams are
Priya Telkar
No longer siloed these two teams merge into merge to form a single team where engineers work across the entire application life cycle from development
Priya Telkar
And test to deployment and operations and have a range of multi-disciplinary skills now devops team use tools to automate and accelerate processes which helps
Priya Telkar
To increase reliability a devops tool chain helps team tackle important devops fundamentals including continuous integration continuous delivery automation and collaboration
Priya Telkar
With all of this the common question arises from from qa or from testing is where does testing fit in all of these where does
Priya Telkar
Testing fit and how is testing or qa in devops different that in agile or waterfall model or how is that how has it evolved
Priya Telkar
In the last last two decades and as a qa what additional skills am i expected to know let us
Priya Telkar
Let us look into it in the next 30 to 40 minutes today and let's try to answer a few of these questions today now
Priya Telkar
There's a big difference uh you know making something work um making something and making something work right uh if you were to take an
Priya Telkar
Example of a pharmaceutical company uh for every five thousand drugs the company makes only one will make it to the market and that process
Priya Telkar
From development to release of the drug can take on an average 12 years that's the price the company pays to do business the same
Priya Telkar
Can be said to other uh businesses like aerospace like manufacturing spacecraft is not a joke you do you uh it is uh you know
Priya Telkar
It takes years of innovation research and testing that goes into before the rocket is launched into space similarly software has always been subject to
Priya Telkar
Rigorous testing failure to do adequate testing can have disastrous result the fact is if you want software that works you need to test it
Priya Telkar
Relentlessly so what are the driving forces for testing in devops so despite despite knowing that testing is important and without adequate testing you're bound
Priya Telkar
To fail yet for most of the software industry even today testing is viewed as a bottleneck that slows down product releases and effects profit
Priya Telkar
In prior decades more software was monolithic and created using the waterfall model in waterfall development activities as we know are faced and gated with
Priya Telkar
Deliverables handed from one department to another and testing happens well after the code is written typically this testing is performed by a tester who
Priya Telkar
Has no interaction with the developer and is an independent of the development team much of the testing particularly ui testing is manual and when
Priya Telkar
Errors are detected which happens far more often than we may admit the code has to go all the way back to the beginning of
Priya Telkar
The process a developer who could have fixed the bug in five minutes if it had been found on the day he or she would
Priya Telkar
Have coded now has to move more himself or herself away from his current work and remembered how the code that was written weeks ago
Priya Telkar
Then once understood the developer needs to create a fix and on top of that an additional hazard the fix itself may introduce new bugs
Priya Telkar
That may require additional testing this this will further delay the release
Priya Telkar
So fortunately most companies now see that phases phased and gated development process are often counterproductive in today's fast-paced highly competitive environment and have embrased
Priya Telkar
And have started embracing agile approach now agile from which devops group promotes having small self-directed interdisciplinary teams to create software they deliver small features
Priya Telkar
Incrementally and iteratively starting with a minimal viable project product a release used to learn from production now agile teams may work in one or
Priya Telkar
Two iterations or they may practice continuous delivery for agile teams the product is never finished it is always evolving
Priya Telkar
Now each team in the agile project process is responsible for the overall quality of the software it delivers the notion of will let qa
Priya Telkar
Take care of it as contrary to the agile way of doing things the level of scale and global competition that have become commonplace in
Priya Telkar
Today's software development environment have created new driving forces that make testing in devops essential and some of these forces are the increased need for
Priya Telkar
Confidence and product quality now modern software delivery as i just said is moving at a rate previously unheard of as as such emphasizing testing
Priya Telkar
As a discrete event or at the end of uh end of a cycle is counterproductive and questionable the need for development speed makes testing
Priya Telkar
In isolation inconceivable testing needs to happen constantly everywhere now the second is the predominance of disruption as a business strategy now disruption is a
Priya Telkar
Driving force in the modern commercial strategies of modern business take amazon for example where in earlier days retailers would want people to walk into
Priya Telkar
Their stores to buy things amazon decided to do the other way got retail to customers through their phone over internet and they succeeded in
Priya Telkar
It and they're continuing to grow retailers who did not catch up to to the disruption are now shutting shops or trying to innovate themselves
Priya Telkar
Again so it is not only amazon but there are so many other examples that we can list out who have uh understood disruption and
Priya Telkar
Embrace change for example uber and ola have changed the way taxes services work today airbnb has disrupted hospitality industry
Priya Telkar
And these have resulted in their success so today the growing trend for success at web scale is business disruption the most important key to
Priya Telkar
Such disruption is quality software disruption only works when a new system put in place are better than the older system being set aside completely
Priya Telkar
Revolutionizing system requires a rapid pace of innovation software development and most importantly testing practices that that testing is designed to ensure teams can achieve
Priya Telkar
Third is the growing dependency of business success on software just about every company today depends upon software whether it is a corner coffee shop
Priya Telkar
That uses point of sale to collect money for the purchase of a coffee or a tea or it could be any manufacturer automotive manufacturer
Priya Telkar
That uses a enterprise resource planning system to make sure cars are coming out of its factory on time and on budget software is the
Priya Telkar
Key here and according to statista the five most valuable companies today are the amazon alphabet microsoft
Priya Telkar
And facebook each of this company success exists solely because of software everyone of this business and every business that use technology is only as
Priya Telkar
Good as the software that drives them hence effective continuous testing of mission critical software becomes a key factor for success of any business may
Priya Telkar
Be in waterfall agile or devops testing approaches so the the last one is the scarcity of broad knowledge and experience and testing at scale
Priya Telkar
Until recently when we used to say automation or testing it was limited to functional or regression testing when we would say that we are
Priya Telkar
Doing automation it was limited to automating regression running automated suits and regression
Priya Telkar
But this has changed like many times that testing is done by a qa specialist um um in traditional way what was to happen is
Priya Telkar
Testing was being done by a qa specialist sitting at keyboard typing of a test according to some predefined list of tasks now as more
Priya Telkar
And more organization have started doing test automation the need for manual regression testers have diminished as a result it has given rise to software
Priya Telkar
Development engineering test or normally called as dats today one stat can automate manual tasks previously done by 10 people following a script of manual
Priya Telkar
Test cases while there is little doubt the value that sds bring there is a downside and as date has
Priya Telkar
So an estate brings in testing and coding and as and therefore is naturally in great demand today so these factors has given to a
Priya Telkar
New term or as we call it as um as revolutionized testing in the way we do testing today and there is a new term
Priya Telkar
That has been coined as dev desktops or qa ops whatever however we want to name it right so dev desktops or qa ops came
Priya Telkar
About to satisfy a variety of needs that have become more pressing as the demand for online software continue to scale to levels previously unheard
Priya Telkar
Of today facebook has over 2 billion active subscribers gmail supports over 1 billion users and these numbers are just growing devops automates most of
Priya Telkar
Now we know that devop automates most of manual operation in the software development life cycle which leads to faster delivery of the product devops
Priya Telkar
Is successful but there are possibilities of missing critical bugs scenarios and business requirement in the product as testing may not be if testing has
Priya Telkar
Not been performed to eliminate the possibility of missing defects functionality and business risk an idea was brought forward in which continuous testing was implemented
Priya Telkar
As a major part of software delivery pipeline and this idea came to be known as either dev desktops or qaobs
Priya Telkar
Now the goal of dev desktops or qa ops is not to silo test from dev and ops but simply raise the visibility of testers
Priya Telkar
And testing as integrated part of the devops quality culture
Priya Telkar
Now this process involves testing early testing often and testing throughout the software delivery pipeline
Priya Telkar
Now dev desktops or qvaobs as we call it highlights the key role of testers in the development of product along with the operation of
Priya Telkar
Professionals it stresses that continuous testing framework should be integrated with your ci cd pipeline it lays most importance on continuity of testing feedback to
Priya Telkar
Developers throughout the stages of the product development thus reducing business risk and possibility of finding defects at later stages it can be simply explained
Priya Telkar
As maintaining software quality by approaching with a devops mindset the technical
Priya Telkar
Excuse me so there is no proper definition or you know how we could want to differ for defined dev desktops or qa ops but
Priya Telkar
The principle behind is simple it is incorporating consistent testing and devops with continuous integration continuous deployment that is the ci cd uh pipeline as
Priya Telkar
Opposed performing testing at the endless at the end of the cycle now this framework expand cooperation between cuba developers engineers and operation hence qa
Priya Telkar
Engineers now should work start working closely with the developers operations and everybody who is associated with the ci cd pipeline
Priya Telkar
So as we see on the right side um dan has to be a co-founder of software testing cleaning illustrate testing in devops as shown
Priya Telkar
In this image he tells he says testing should happen everywhere at each and every point of devops a tester or a qa needs to
Priya Telkar
Be involved so testing needs to happen early testing often and testing throughout that is the key emphasis of in getting involved as a testing
Priya Telkar
In devops continuous testing is a heartbeat of testing in uh devops so continuous testing um to to summarize it is a process of executing
Priya Telkar
Automated tests as part of the software delivery pipeline in order to obtain feedback on the business risk associated with software release as rapidly as
Priya Telkar
Possible now it evolves and extend test automation to address the increased complexity and pace of modern application development and delivery
Priya Telkar
Now continuous testing really boils down to providing right feedback to the right stakeholder at the right time for decades as uh we already spoke
Priya Telkar
About it uh was traditionally referred until the end of cycle at that point tester would provide all sorts of important feedback but nobody really
Priya Telkar
Wanted to hear it because it was too late and there was little the team could feasibly do except delay the release with continuous testing
Priya Telkar
The focus is on providing actionable feedback to people who really care about it at the point when they are truly prepared to act on
Priya Telkar
It the word continuous means code is continuously deployed delivered tested and deployed the testers identify possible scenario based on requirements create execute test cases
Priya Telkar
From the beginning of the software delivery pipeline and share feedback to the development team on the business risk involved
Priya Telkar
Now continuous testing does not require any specific type of approach shift left to shift right or any testing tools however it requires that an
Priya Telkar
Actionable feedback is delivered to the right stakeholder at the right time testing occurs across all the phases of the software delivery pipeline now the
Priya Telkar
Scope of continuous testing is pretty huge with validation of functional and non-functional requirements of the product it involves api testing unit integration and system
Priya Telkar
Testing performance testing of the software all done under a simulated environment with test automation it is an uninterrupted execution of automated tests while being
Priya Telkar
Part of the software delivery process facilitating immediate feedback based on the business changes associated with the product and mitigating risk before they proceed to
Priya Telkar
The next sdlc stage now the primary goal of continuous testing is to assess the business risk coverage it provides instant insta insight on whether
Priya Telkar
A release candidate is too risky to proceed through the delivery pipeline
Priya Telkar
It establishes a safety net that helps the team protect the user experience in the accelerated development process and avoid software failures
Priya Telkar
Continuous testing is seamlessly integrated into your software pipeline and the devops tool chain uh continuous testing embraces everything from shift left that is unit
Priya Telkar
Component coverage testing to shift right monitoring apm testing and production as testing is implemented at each stage and most of the processes are automated
Priya Telkar
It leads to few of these improvements the defects are detected early it shortens the regression cycle from weeks to hours by just automating the
Priya Telkar
Process itself the developers and testers work together with leading to a better understanding of the module and increase the quality of the product exponentially
Priya Telkar
The testers get a chance to perform all kinds of testing during the phase of a product development uh the tester becomes an equal owner
Priya Telkar
Of the product as a developer as us as a developer automated build and deployment accelerates the process and avoids any human error and dependency
Priya Telkar
Now what are the factors that influence continuous testing there are three people process and technology now each person in a team has a unique
Priya Telkar
Responsibility in the delivery pipeline for it which he or she must possess the required skills trans uh the person the people should be transparent
Priya Telkar
And regular communication between members is a key to success here process remains the key in continuous testing instead of automating everything focus should be
Priya Telkar
On test automation code quality stability efficiency and providing timely feedback to the developer
Priya Telkar
Technology should be leveraged to get a stable testing environment build proper alignment between the team skills and software tools
Priya Telkar
It is important to recognize that no tool can instantly give you continuous testing like agile and devops continuous testing requires changes throughout the people
Priya Telkar
Process and technology however trying to initiate associated changes in people and process when your technology is not up to your task will be an
Priya Telkar
Uphill battle from the start so when we start on the continuous testing journey we need we need to make sure that all the three
Priya Telkar
Of them are aligned and all the three of them are taken care of
Priya Telkar
Because if we don't if we lose or if we fail to consider one of them we end up losing all
Priya Telkar
Now where does automation test automation play a role in continuous testing one thing that we need to understand is if we are doing automation
Priya Telkar
It does not mean we are doing continuous testing so test automation itself does not employ continuous testing continuous testing is much more than it
Priya Telkar
Is much more than test automation so before continuous testing evolved uh you know or doing automation in chunks like maybe functional or regression was
Priya Telkar
A norm about ever-growing requirements of modern application the complexities of testing
Priya Telkar
That idea of automation of is making it less effective now despite having similarities it is false to assume as i just said that continuous
Priya Telkar
Testing and automation are the same thing now test automation is designed to produce a set of pass or fail related to user stories or
Priya Telkar
Application requirements now continuous testing however focuses on the business risk it provides insight on whether a software can be released to achieve this shift
Priya Telkar
We need to stop asking are we done testing and instead concentrate on does the release candidate have an acceptable level of business risk now
Priya Telkar
Continuous testing goes beyond test automation it aims to ensure continuous quality improvement throughout the whole software delivery pipeline it emphasizes continuous process improvement while
Priya Telkar
Test automation provides uh as with the critical sensors for detecting software defects uh continuous testing highlights process improvements that can prevent future defects from
Priya Telkar
Occurring now the constant monitoring of result and feeding uh back to the process is the key to improve your test effectiveness the focus of
Priya Telkar
The team moves from defect finding and fixing uh fixing to getting ahead by evolving and defect prevention so defect prevention plays an important role
Priya Telkar
Here the diet loop created with continuous testing lets managers move from firefighting to looking at process improvement and eventually optimizing
Priya Telkar
Now why does shift to devops makes desktop automation imperative why is it important
Priya Telkar
Now i don't as uh as i told earlier modern application development uh involves releasing increasingly complex and distributed applications um on tighter timelines it
Priya Telkar
Was not possible to complete the required scope and complexity of testing in sprint without careful design and
Priya Telkar
You know so there's basically less time less time available to test so in sprint where you have to complete all your testing in two
Priya Telkar
Weeks manual test cycles takes weeks to do it so manual testing just does not work here so so there is a need of automation
Priya Telkar
Uh teams expect now since since the teams have started working in an agile and devops mode they are expecting continuous near instant feedback now
Priya Telkar
Agile and devops team expect as i said feedback to be delivered continuously throughout the release cycle now this isn't possible if you're doing manual
Priya Telkar
Testing even if you hire a large number of testers right without faster feedback on how the latest changes impact core end-to-end transaction accelerated delivery
Priya Telkar
Puts a user experience at risk with each and every release
Priya Telkar
And the last or not list is the business expectations are dramatically different now as companies are prioritizing digital transformation the old adage of speed
Priya Telkar
Cost quality no longer applies now the pressure is to stabilize cost i.t leaders are now expected to deliver more innovative application faster than ever
Priya Telkar
Today everyone from the ceo down recognizes that skimping on quality inevitably leads to brand erosions as well as customer defection and regulated industries the
Priya Telkar
Repercussion of subpar quality are even more severe so where does automation testing fit in automation testing fits everywhere right unit is while you do
Priya Telkar
Unit so it's not restricted only to functional or regression testing as we used to do a decade earlier today automation testing is evolved and
Priya Telkar
We people uh the teams are trying to automate each and every aspect of the process like unit test now unit test check a function
Priya Telkar
Or a class in isolation so unit tests will cover an individual function and they are inexpensive and quick to implement integration test will check
Priya Telkar
If you if your new added module work well with others then functional validation tests determine whether a specific requirement is satisfied an end to
Priya Telkar
End test also making sure that end to end of the application works seamlessly performance tests measure your applications reliability scalability and availability
Priya Telkar
So how to maximize um test automation efficiency and devops by selecting right tool and framework understanding getting your basics right defining the performance metrics
Priya Telkar
To see pass and fail uh developing good documentation practices and leveraging them into your ci cd processor excuse unjust excuse
Priya Telkar
So what are the top challenges uh that we are seeing in order to increment uh uh continuous testing one is the increased complexities application
Priya Telkar
Are being uh the newer applications that are being released are more complex with multiple integrations so as a scope of product grows so does
Priya Telkar
The scope of uh testing so with large number of tests added to the system it becomes challenged to make the test execute quickly so
Priya Telkar
If text if a test takes too long to run it defeats the whole purpose of continuous testing as quick feedback is not available if
Priya Telkar
Not all tests are run it makes it seems like a compromise on the quality of the product also if not all tests are run
Priya Telkar
It makes the effort of adding all those tests in the system going way other one is
Priya Telkar
Trying to automate every test now the challenge might have been previously the challenge was not automating enough getting testers to board the automation train
Priya Telkar
Having them contribute and constantly run automated tests was the first step but the challenge now is that we're trying to automate everything
Priya Telkar
Now this is resulting in huge test suits that are unmanageable and take more time in maintenance than testing itself moreover they cannot be run
Priya Telkar
Continuously and thus defeat the whole purpose of automation now we know the benefits of automation test but we also must realize that uh every
Priya Telkar
Test is not worth automating so uh when when we are putting together plan it is very essential to make sure that we pick the
Priya Telkar
Right suit and uh we design our automation suit wisely right teams need to have the you know it's very essential to have a checklist
Priya Telkar
Of criteria or for test that is needed to fulfill in order to make a test automated suit and we need to adhere with that
Priya Telkar
Checklist and your tests should be nimble i mean your automation suit should be as flexible as possible and they should be such that they
Priya Telkar
Should be you should be able to execute them on demand in full or in parts uh the other most important challenge is choosing popular
Priya Telkar
Testing tools over the right tools now since we need to pick up tools to make our own devops pipeline we are faced with a
Priya Telkar
Choice of a multitude of tools there are uh innumerable tools today available doing different things in the market today and with so many tools
Priya Telkar
Uh promising us the best features and quality we most often find ourselves taking a safe bet with the most popular cane down the block
Priya Telkar
Right so while that might seem to be a safe bet in the beginning but it could turn out to be expensive later on so
Priya Telkar
We must not just go by the popularity of a tool or just pick an open source tool because it is free of cost do
Priya Telkar
A survey uh do a market survey for the actual feed for your team the tools we select have to fit to the context meet
Priya Telkar
Your unique needs and be something the team can work with and appreciate do your pocs before choosing a tool do your pocs have your
Priya Telkar
Team run it get enough demos make sure that customization is possible and run multiple pilots before you finalize any tools uh you add and
Priya Telkar
Uh to add to your then there is lack of faster feedback loops now to leverage continuous testing we have known that it is important
Priya Telkar
To incorporate feedback now feedback is the essence of continuous testing now to inter incorporate feedback on a continuous basis you need feedback loops in
Priya Telkar
The system that can help you gather feedback in real time now lack of such loops introduce a delay in action for example if one
Priya Telkar
Of your test environment used to that is used to run automation test is down an alert message for the same will help you act
Priya Telkar
Timely to rectify it rather than digging into cause of the non-arrival of test report for scheduled automation run so basically as soon as your
Priya Telkar
Environment is down you should get a trigger saying your environment is down so that you can take a corrective action and not actually wait
Priya Telkar
Till the point that you were expecting a report and the report does not come and then you start debugging so the need for including
Priya Telkar
Feedback mechanism at every uh checkpoint is very important so it also helps to have real-time dashboard to monitor performance which depicts the performance metrics
Priya Telkar
Over a period of time rather than digging into locks and code profiler report every time you want to check a product's performance when such
Priya Telkar
A dashboards are accessible to everyone on the team it helps bring critical issues to the table and get them prioritized
Priya Telkar
Then um one of the other challenges the inefficient processes itself right now processors now processes are good to maintain the sanctity of the project
Priya Telkar
And delivery uh deliver consistent quality now having checklist for each task as well as clear definition of done and exit criteria help the team
Priya Telkar
Know their goals and direction whatever you do within the team must be defined explained and agreed upon we can make improvements but if we
Priya Telkar
Keep adding more and more processes during the ongoing iteration they can cause more harm than good now introducing new rules or mandate during course
Priya Telkar
Of development feels like an overhead and causes confusion and delays apart from every urgent all critical changes it is best better to reserve any
Priya Telkar
New process change for a retrospective meeting with the entire time before bringing them into action now sometimes um the process followed in an organization
Priya Telkar
Are not conducive for achieving continuous testing for example change in requirements now if requirement specification keep on changing it creates a lot of rework
Priya Telkar
For the team especially the testing team as tests may need to be updated every time there is a change in requirement this adversely impacts
Priya Telkar
The effort of continuous testing unclear roles and responsibility if the roles and responsibility of team members are not clearly defined it may result in
Priya Telkar
Ambiguous ownership of tasks such ambiguity can lead to redundant efforts on some tasks and some tasks getting totally ignored so clear ownership of task
Priya Telkar
Is important then is excluding testing team in the initial discussion so if testing team is not included in all product related discussion from the
Priya Telkar
Very beginning it would create gap in understanding which may impact continuous testing
Priya Telkar
Also it would require additional process such as handoffs from developers to testers from time to time adding inefficiency to the whole system
Priya Telkar
Now what do we need to look out while picking up the right tools right um i just give a just about it when i
Priya Telkar
Was talking about the challenges is automation one of the things that you need to look out when you're picking up any tools for achieving
Priya Telkar
Your continuous testing is the technology supported now your choice of tool will largely depend upon the type of application that is being tested
Priya Telkar
Now search for a tool uh that meets the requirements of the technology or application you are looking to test and consider selecting a tool
Priya Telkar
That spans across multiple technologies allowing you to scale automation and achieve greater return on investment integration capabilities this is the most important make sure
Priya Telkar
The platform is easy to integrate uh to your pipeline a tool should come with relevant plugins for the most common pipeline orchestrators or well-documented
Priya Telkar
Api allowing the orchestrator to control the test automation platform but in general today most of the tool come with wide variety of integrations and
Priya Telkar
So making sure that whatever tool you pick up easily integrates to your devops pipeline is imperative right execution time now this is like
Priya Telkar
If you have a fully automated pipeline the time needed for running a test is crucial now make sure uh the test automation platform allows
Priya Telkar
You to scale uh execution of test cases to keep runtime at a minimum so while you're trying to pick up tools make sure that
Priya Telkar
The tool allows you to schedule your test it should allow you to run test unattended around the clock and it should also and one
Priya Telkar
Of the most important things that we need to keep in mind is the tool that you choose or pick should allow you to run
Priya Telkar
Multiple tests in parallel that is if you're testing a web-based apple uh web application which is which is uh accessible through web browsers you
Priya Telkar
Should be able to initiate testing simultaneously across all browsers chrome firefox safari based on the browser supported by the application if it is a
Priya Telkar
Mobile device application your tool should support parallel execution that at a cl when you execute or when you initiate or when you trigger the
Priya Telkar
Automation you should be able to run your scripts on simultaneous devices like android ios in parallel so that your execution time reduces and you
Priya Telkar
Get and you you you are you are saving out on a lot of time there right uh learning curve um now uh some of
Priya Telkar
The tools that we see uh in the market are overwhelming for it could be newcomers or people who are already using some kind of
Priya Telkar
A tool right because they have added unnecessary complexities and some of them are too complicated in themselves to use right so regardless of choice
Priya Telkar
Uh make sure that you receive adequate training uh you should make an estimate so so uh learning curve or while you are planning your
Priya Telkar
Test strategy make sure that estimating the time to learn the new tool is also taken into consideration right so you should make an estimate
Priya Telkar
Of how long you would take your team to be able to adopt the tool in their daily work and how time consuming it will
Priya Telkar
Be to maintain these tests it's often the later that team breaks then exxon so even maintenance of these scripts later on should be easy
Priya Telkar
And last but not the least is make sure that the tools that you pick are aligning with the business expectation if done right implementing
Priya Telkar
A tool a continuous testing tool is a great investment now consider how the tool will help you achieve the level of process optimization required
Priya Telkar
To meet your business goals take into consideration all aspects of continuous testing identify cases for automation uh developing uh the test execution reporting and
Priya Telkar
Acting on results and defining action for when things fail like does this tool uh offer self-healing um or you know how is the reporting
Priya Telkar
What kind of reports are generated how intuitive the reports are how how how do they uh do they give you a logs analytics how
Priya Telkar
Is it it is to decode them how well you can share the reports how will the tool be able to optimize all of the
Priya Telkar
Activities and in help to increase the overall product quality etc so in short while you are trying to pick a tool make sure that
Priya Telkar
Your tool has a good integration with other tools uh it has robust api support it has cross-platform support right uh it offers customization in
Priya Telkar
Case i do you require any customization on top of the existing feature that a tool offers the vendor should be able to provide you
Priya Telkar
Support on that ease of use they should have a central database performance overall performance a price also plays a very important role uh though
Priya Telkar
Though uh you know plays an important factor while you're picking up the tool and uh um cloud support again today most of the applications
Priya Telkar
Are on cloud so your application should easily work uh or you should be able to integrate directly on the application that are hosted on
Priya Telkar
Cloud and uh bug detection bug fixing uh you know uh you know logging box automatically etc and good customer support
Priya Telkar
So so in summary a good test devops test strategy should take care of your automation frequent iteration continuous improvement and collaborative approach now a
Priya Telkar
Successful devops testing strategy is aimed at building testing releasing software faster and more frequently automate as many tests as you can but don't automate
Priya Telkar
Everything so manual test no matter how careful you room for errors so automate test is the need of the day and you can run
Priya Telkar
It as many times as possible without human errors right finally um make sure that you know you keep notoriously bitter test script from overwhelming
Priya Telkar
The team with false positive create test for every new modified requirements establish a framework that supports reuse of data and supports reuse and data
Priya Telkar
Driven testing keep individual test and broader test firmwork in sync with the constantly evolving application frequent iterations small code chunks should be returned in
Priya Telkar
Time box print regularly tested to ensure high software velocity and deployment continuous improvement testing is performed at every stage of the life cycle feedback
Priya Telkar
Is continuously incorporated into the development to ensure that product performance is continuously optimized and improved and collaborative approach as a key or successful uh
Priya Telkar
Devops test you know embracing testing in devops development operation teams working in conjunction rather than silos quality assurance forms a bond between the two
Priya Telkar
Results in an unified approach seamless communication and higher efficiency
Priya Telkar
So how do you start get start testing with your how how do you get started with testing in devops skill yourself and your team
Priya Telkar
On devops testing engage or devop test consultant and appoint a architect to conduct an assessment of your current testing practices they would you know
Priya Telkar
Define a roadmap with the help of them based on the assessment outcome the solution rate roadmap should define a test steps test strategy for
Priya Telkar
The product metrics to monitor performance for testing select a pilot application to begin with implement the test infratax test infrastructure framework and tools according
Priya Telkar
To the solution roadmap train cross-functional team members on test creation methodologies and tools after a pilot project is successful expand it to rest of
Priya Telkar
The product and keep monitoring for continuous and put continuous improvement in place
Priya Telkar
So just to summarize few of the best practices is involved from the beginning uh testability should be part of the low level so get
Priya Telkar
Involved from the beginning from the time requirements are designed uh the testing team should be part of it understand the requirement hand in hand
Priya Telkar
With the business and the developers apply a broad range of tests throughout the testing process which includes unit testing integrated testing regression testing and
Priya Telkar
Production testing evaluate your tools and framework before you include them in your system evaluate your budget requirement before starting on a continuous testing journey
Priya Telkar
Scale your test environment to run test in parallel make use of cloud-based cross-browser testing platform to reduce test times as much as possible parallel
Priya Telkar
Testing should be one of your major consideration while you are running your test have skill testers efficient as data management integrate analytics um within
Priya Telkar
The test process which can generate right insights throw light on the key functional issues and check the consistency of the test result and resolve
Priya Telkar
All your inefficient processes way in the beginning then in between
Priya Telkar
Now processes that are inefficient and not well designed are brown to create bottlenecks uh in the overall effort of achieving continuous testing such processor
Priya Telkar
Should be resolved before they become part of continuous testing initiative
Priya Telkar
So that's it from my side and thank you for patiently hearing
Dinakar
That thank you thank you so much uh priya for sharing your valuable insights with some practical examples and real world scenarios uh you know
Dinakar
Your presentation has covered a lot of practical pointers and you know they've provided a lot of insightful experiential knowledge it is truly an honor
Dinakar
To be hearing from you thank you for that you know for the rest of the participants uh you can share your questions that we
Dinakar
Will be uh sharing with priya and she will be able to take them one by one
Dinakar
So we leave it for the q a session for some time we'll keep that open for the next 5-10 minutes and then we'll call
Dinakar
It a day all right i do have a few questions coming in uh one of them are here what are some tools that you
Priya Telkar
Would recommend for continuous testing okay so there are no as i was saying right there are no fixed tools for any continuous testing so
Priya Telkar
If you're doing automation testing you can start with selenium or you can if you uh if
Priya Telkar
You are having highly intuitive complex scenarios selenium or apm may not suit your need right then you can start looking out to uh
Priya Telkar
License tools similarly for every aspect of continuous testing right from unit testing to uh your uh integration to continuous deployment uh to uh your
Priya Telkar
Defect tracking right so you can rely on tools like jira or alm so there is nothing called as for a success of continuous testing
Priya Telkar
You need to rely on these tools as i emphasized um it all depends upon what is your appetite and what kind of application are
Priya Telkar
You testing what is the need of the day right what is what is your application landscape and what is the devops tool pipeline that
Priya Telkar
Is in place so so these things should be taken into consideration while choosing a tool and there is wide gamut of tools in the
Priya Telkar
Market today based on your needs go ahead and start using them but use the right tools
Dinakar
All right got it um so kiran was asking uh as a qa exec how do we practically get involved in testing early
Priya Telkar
Uh testing early um easier said than easier said than done right it's a cultural shift it it is it is a cultural shift where
Priya Telkar
The testing team uh should be involved i mean it is it should come from top down right so the testing team should get involved
Priya Telkar
In the very beginning from the time the requirement gets start documenting so that the tester can start involving very early can give suggestion feedback
Priya Telkar
From an user experience point of view right and get better understanding of the product but then as i said as an individual it is
Priya Telkar
Not uh possible but it is an organizational or or an effort that your leadership should put in to make sure that qa is involved
Priya Telkar
From the very beginning and when i say very beginning from the time the product is you know initiated from the time you start talking
Dinakar
Requirements right right okay i think uh you know is passing on a few questions to you as well uh but before that or could
Dinakar
You take this last question uh that what are some skills that are required uh for implementing or adapting devops model uh for a user
Dinakar
Who is you know for a user who is new to devops itself so what are some skill sets that are required
Priya Telkar
[Music] skills uh there are both skills right from our devops point of view if you're starting there are two um there are a few
Priya Telkar
Skills that you need to keep in mind are from a from um soft skill to technical skills right soft skills would be your communication
Priya Telkar
And collaboration uh you should uh uh when you start working in a team of a team which is collaborating so communication plays a very
Priya Telkar
Very very important role so one of the main skills that i always keep saying even to my team right communicate well ask the right
Priya Telkar
Questions so communication is one of the top skills right soft skills as i said should be should be important i know technical skills come
Priya Telkar
Along right based on the type of automation tools you pick up you start learning maybe you know by type of scripting languages would be
Priya Telkar
Java javascript python that does not matter that's that's that's part of your uh
Priya Telkar
You know day-to-day uh working because you you have identified a tool you learn to know how to use them but then what i understand
Priya Telkar
Is you need to understand you need to sharpen your soft skills uh you need to sharpen your coding and scripting skills so based on
Priya Telkar
What kind of tool what kind of an application um develop your skill set around that scripting language it could be python it could be
Priya Telkar
Javascript whatever right based on today we are slowly moving towards low code no code tools also but that's the thing in the future but
Priya Telkar
Right now a lot of tools requires you to have a good knowledge of coding and scripting stick to one scripting language it could be
Priya Telkar
Javascript it could be python whatever it is right based on the type of tool your organization is catering to be be good at it
Priya Telkar
And learn cloud skills because all of the applications are hosted on cloud so learn about all the cloud infrastructures right and your basic testing
Priya Telkar
Skills should be good you should know the nitty-gritties of testing right everybody knows that testing is making sure you get expected result of whatever
Priya Telkar
Input right but that is not all about it uh you need to know and you should be a customer i always say that when
Priya Telkar
While you're doing a testing don't think of yourself as a tester developer test as if you're an end user so that is one of
Priya Telkar
The skills that you need to develop test with keeping um you know customer should be a focus and you should be proactive uh take
Priya Telkar
On new roles make on new skills try to learn new skills if you are doing automation testing today learn api testing uh try to
Priya Telkar
Understand different aspects of testing so that you get involved in different aspects of testing but that's about it i think and these are a
Priya Telkar
Few of the important skills that you need to know if you want to start a devops journey
Dinakar
Thank you if you i mean we have time for maybe one or two questions uh if you have anything on your kitty you can
Dinakar
Take them on okay here here's another question priya how how easy is it to switch from traditional testing approach to a devops model
Priya Telkar
This is a question from sashi easy or it easy or difficult it's a difficult question to answer but a good question also right um
Priya Telkar
It's it's it's a big change in how you're doing things right so in traditional way we know that uh testers get involved at a
Priya Telkar
Much later stage well well a developer is happening and we do independent testing because that is how things have been working but right now
Priya Telkar
Uh the transitioning i think it's all about conditioning your it's all about mindset conditioning right have you conditioned so you need to be involved
Priya Telkar
From very day one you need to take take control or you need to take the owners of quality so quality as a tester you
Priya Telkar
Should not you know as an tester because i have been a tester myself right for 16 odd years so so the journey is take
Priya Telkar
Responsibility from the beginning so the whole mindset or how things we did traditionally changes while it comes to agile we get involved from day
Priya Telkar
One and uh you know uh get involved from day one collaborate well with developer and operations which was not happen earlier so there's a
Priya Telkar
Big change in how we did it did testing in um waterfall versus agile once you start adopting to agile you find it is much
Priya Telkar
Easier and better way to do things because uh you get more better uh you you find effects or you give feedback they are responded
Priya Telkar
Uh you know immediately you see things changing you think you see you getting more involved and you see uh changes happening uh you know
Priya Telkar
Um very frequently rather than it could have happened while in traditional uh mode uh while in auto fall mode you may come up with
Priya Telkar
A piece of code or you may come across a feature which may be working as expected but you feel from an user perspective it's
Priya Telkar
Not a right flow to follow and you give your feedback but nobody really wants to take it up because they run out of time
Priya Telkar
And it is not feasible right but while in an agile you have an upper hand here because you are part of the team from
Priya Telkar
The very beginning so you are cust your feedback even as a tester are taken into consideration and with continuous testing you are involved from
Priya Telkar
The very beginning from requirements and also and it does not stop after production today uh the testing has gone beyond production there's a concept
Priya Telkar
Called a shift test shift right where we still continue to monitor how the application is uh uh you know how the users have embraced
Priya Telkar
The application how is it doing how how what what features are failing or what is doing well and you become part of the whole
Priya Telkar
Cycle so i don't i don't say it is difficult or it is easy it's just about a mindset change it's about how we used
Priya Telkar
To work how we are supposed to work here we are expected to be more more proactive more uh collaborating all the time and being
Priya Telkar
In being on toes all the time right so taking complete ownership of the uh product as would a developer or a business or two
Priya Telkar
So it's all about mindset change it's not about how difficult or how easy it is great great
Dinakar
Well thank you for all of that uh insight and thank you for answering those questions priya it was quite helpful and i'm sure uh
Dinakar
Most of the participants who asked those uh their answers are given uh but yeah it's been a true honor uh to be hearing from
Dinakar
You priya once again and uh we also want to thank each one of our participants for joining us for the first event in the
Dinakar
Breaks breakfast series uh wish your you know priya's insights and knowledge on the topic has sparked a few ideas that you can take back
Dinakar
And implement for yourself and also please feel free to reach out to me with any questions uh you know uh i'll be sharing my
Dinakar
Email address uh on on the chat uh so you i'll respond to that uh as soon as possible but thank you once again uh
Dinakar
For thank you everyone for being such an engaging audience today good day
Priya Telkar
Thank you thank you for the opportunity to me also thank you
