Dinakar
All right great uh hello everyone and welcome to Pcloudy's webinar on unlock OCR testing biometric authentication and media testing with Pcloudy my name is dinakar and I'll be the host for today.
Dinakar
Before we get started I would like to go over a few housekeeping rules uh you would have noticed that your line is currently muted.
Dinakar
However you can submit your questions during the webinar using the Q&A option uh available below we will answer your questions as part of the Q&A section at the end of the webinar please note.
Dinakar
That this webinar is being recorded and we will send out the link of the recording later with that said let me introduce the speaker for today Jessica Selvin Jessica is a pre-sale specialist at.
Dinakar
Pcloudy she has around three plus years of experience in the IT industry and prior to her role at Pcloudy she has worked with LTI Mind Tree as a pre-sales consultant in automation.
Dinakar
Solutions design and she's done this for various Industries while her stent at LTI she also has a keen interest in data analytics and various automation tools without further Ado let me hand it to.
Dinakar
Our speaker for today, Jessica Selvin, over to you.
Jessica Selvin
Uh, thanks, thanks a lot for that introduction Dinakar, and um.
Jessica Selvin
Yeah so let's get started so hello everyone and uh good evening uh so so uh the topics for today uh that we're going to be primarily covering is OCR testing biometric authentication and media.
Jessica Selvin
Testing and how that plays into your application testing your day-to-day application testing and how Pcloudy our platform enables you to do testing for all these.
Jessica Selvin
Right um so with that let me just run through the agenda yeah so uh firstly we will look into OCR uh what it is what are some real world applications and use cases that.
Jessica Selvin
We see in terms of OCR um and Then followed by biometric authentication uh real world uh use cases that we see for that as.
Jessica Selvin
Well as media injection in application testing and some real world applications um then we will move into a demo a live demo and.
Jessica Selvin
Then further we can take up uh some the questions and clarifications that you might have um so with that uh let me delve into to the OCR.
Jessica Selvin
Yeah so what is OCR right uh basically the basic definition or the full form you can say is optical character recognition and what this means is it's a technology that converts different types of.
Jessica Selvin
Uh documents so be it your hard copy uh scan paper documents PDFs or images that are captured by your camera.
Jessica Selvin
So all these into digital text or editable and searchable dat data so the primary aim of OCR is to digitize your printed text.
Jessica Selvin
So that they can be electronically edited and searched uh digitally stored speech software and so on uh so some of the key applications and roles that we see OCR playing in is uh historically.
Jessica Selvin
We've seen how it has helped massively in the data entry uh field uh where you know OCR facilitates automatic data entry from paper documents and reducing the need for manual uh data input.
Jessica Selvin
So saving uh lots of time and improving accuracy and so on and uh secondly we see it being used in Translation and language assistance.
Jessica Selvin
So uh OCR technology can convert uh any image into text which can further be processed uh with translation software into different languages um on those same lines even in terms of accessibility.
Jessica Selvin
Right so making your uh application or your content accessible to visually impaired users uh so make uh OCR can ensure that once it's converted to text uh text it can be uh read aloud.
Jessica Selvin
By screen readers uh increasingly we are also seeing it being used as a form of identity verification uh so by extracting information from your ID uh your identity documents.
Jessica Selvin
Right uh OCR helps in verifying user identities so mainly we see this being used uh in the banking as.
Jessica Selvin
Well as the the travel Industries and overall digitalization uh OCR moving your documents U that are stored maybe manually in or historical records into digital formats that save storage makes them easily searchable accessible.
Jessica Selvin
And so on and also uh furthermore even an augmented reality where OCR can be used to read and interpret text in real world uh environments that enhances the quality of the AR or augmented.
Jessica Selvin
Reality reality experiences right uh so and all these we see uh in terms of the benefits that we see that comes out of OCR is one is improved accuracy it minimizes uh human errors.
Jessica Selvin
Right and then secondly um faster image and document processing right so it's much faster it saves on a lot of time uh say um cuts down on the resources that are required to process.
Jessica Selvin
That data and cutting down costs and all this um enables you to have efficient work flows be whichever industry Healthcare manufacturing um banking sector and.
Jessica Selvin
So on so now we will look into some real world uh examples of right sorry but before that uh let's just have a quick poll on how uh you might be using OCR on.
Jessica Selvin
A day-to-day basis and what are um the kinds of um activities that you might do be it in your work or your personal life uh where OCR comes in into picture for you.
Jessica Selvin
So um let me just read out the question I hope the poll is visible for all of you um.
Jessica Selvin
So I have used the OCR feature to option one extract text from an image convert image to PDF uh copy text on camera and digitize handwritten notes.
Jessica Selvin
So maybe I'll just give it uh 15 to 20 seconds for uh you to answer this question right so I can see some answers coming in a lot of people using um the second.
Jessica Selvin
Option converting image to PDFs this often comes in handy uh right and also extracting text from images so these two are what I can see mostly um folks are using.
Jessica Selvin
So yeah this is interesting to know right and also this helps us to be aware that even though we may not be aware of the terminology of OCR uh we are practically using this.
Jessica Selvin
On a day-to-day basis and um not just um on uh an individual level but we can also be aware that enterprises and several business requirements where OCR comes into play.
Jessica Selvin
So with that uh maybe we can just go into the next uh slide and we I'll talk about the real world applications that we see uh in terms of OCR.
Jessica Selvin
So uh one is Bank check scanning right so here this is something where we saw uh one of our clients which is US based in the banking sector had this requirement.
Jessica Selvin
So basically having the requirement to read or automatically read and process uh printed text on checks so this involves extracting the significant data from the checks like the check number the account number the.
Jessica Selvin
Date and so on right so uh one of our clients had this requirement and OCR was u a key player in ensuring that this process happen seamlessly uh secondly we.
Jessica Selvin
Also saw uh see the application in terms of manufacturing and supply chain Inventory management uh OCR being able an OCR scanner that reads labels and orders on products and as they move through the.
Jessica Selvin
Warehouse uh it'll be able to update the inventory levels and statuses in the Supply Chain management system so this really uh helps in having a realtime tracking and monitoring of your inventory your purchase.
Jessica Selvin
Orders um and streamlining your inventory management so we see uh an application there uh also thirdly on the ID verification I touched upon this uh before uh.
Jessica Selvin
Basically OCR technology really comes in handy in in travel Industries where OCR technology can be used uh for to speed up the check-in processes where your ID cards are verified you might have experienced.
Jessica Selvin
This as you traveled uh or took a boarded a flight right you might have experienced this so This improves the security for one it speeds up the process and.
Jessica Selvin
Also brings inconvenience so one of uh we also implemented this for one of our Middle East on clients it was a banking client where they their form of um verification was uh through scanning.
Jessica Selvin
The ID and uh verifying the credentials of the user right so uh it had an ID card upload where one of the that was one of the steps in their application for verification and.
Jessica Selvin
It came into play OCR came into play for their application uh also we see it in um implemented in healthcare.
Jessica Selvin
So a lot of the times certain um medical uh prescriptions medical forms all these can be uploaded and converted into digital text uh into the patients electronic health record or ehrs and uh finally.
Jessica Selvin
Overall in terms of any industry that wants to digitize that has a lot of documents that are uh stored manually uh to convert that and make them uh into digital formats saving space improving.
Jessica Selvin
Accessibility and being able to edit and search and so on right so these are some of the real world applications where we see OCR coming into play uh.
Jessica Selvin
So with that summary on OCR uh let us just move into biometric authentication so this is something that we might be using again on a 30 day-to-day basis to access our devices unlock our.
Jessica Selvin
Devices access um unlock an application and so on and uh so just to give a quick definition about what it is this technology involves the verification of identity using our unique biological traits.
Jessica Selvin
So the most common forms that we might be familiar with is fingerprint scanning facial recognition also some others include IR scanning and voice recognition and.
Jessica Selvin
So on but the main uh the the kind of biometric authentication that we come mostly day-to-day is in terms of touch and face recognition.
Jessica Selvin
Right and uh so this provides a high level of security for one and it also brings about uh an ease of use ease of access.
Jessica Selvin
Because there's no longer the requirement to remember passwords or user IDs and so on prevention of fraud so impersonation becomes harder.
Jessica Selvin
Because this is based on your unique biological trait it can also be a form of an added layer of security over and above your passwords and pins and.
Jessica Selvin
So on and ensuring overall uh compliance in terms of the industry security standards so uh yeah just to summarize where it comes into play.
Jessica Selvin
Right uh be it in mainly we see biometric authentication coming into play in the banking sector where uh most of many banking applications uh have this as a prerequisite to enter into the application.
Jessica Selvin
To verify your identity through biometric authentication um it helps in prevention of impersonation and fraud and becoming an added layer of security.
Jessica Selvin
So um with that summary on biometric authentication let me just move on to the final um feature that we'd be talking about which is Media injection.
Jessica Selvin
So uh what is media uh testing in application right so it is it refers to the process where we evaluate how an application handles various media elements.
Jessica Selvin
So be it images audio video uh right um a lot of modern applications now involve the use of opening up your camera and scanning a q code for example or a barcode uh uploading.
Jessica Selvin
An image uh and so on right so ensuring that your application is able to handle these kinds of different um multimedia content.
Jessica Selvin
Right so this becomes a critical part of ensuring that there is good user experience there is seamess user experience.
Jessica Selvin
So testing the this component of your application is critical uh ensuring compatibility that your application is compatible with all the popular formats in terms of be it uh image formats be it PNG uh.
Jessica Selvin
Jpg JPEG and so on right so ensuring there's compatibility and overall quality assurance ensuring that the entire workflow is smooth and there are no bottlenecks um in your workflow.
Jessica Selvin
Right so uh media testing comes into critical play there uh now again let's just take a quick poll uh to see where media comes into play in our day-to-day lives I hope the question.
Jessica Selvin
Is visible to you so yeah uh I majorly receive or send media files to option one colleagues option two family and friends three myself and four none of the above.
Jessica Selvin
So yeah maybe I'll just give 10 to 15 seconds to answer this so yeah I see a lot surprisingly a lot of them are to themselves.
Jessica Selvin
Yeah I mean it really comes in handy to have something in reference so yeah I'm sure this is something that we all do and uh secondly a lot to colleagues yes I mean in.
Jessica Selvin
Terms of be it via emails or teams or whatever collaboration tools we're using I think these are the top two that I'm seeing that are coming in.
Jessica Selvin
Okay so with that let me just go into some of the real real world examples that we see in terms of media testing uh.
Jessica Selvin
So one of the critical um uh places where um media injection comes into play is scanning of QR codes.
Jessica Selvin
So we see in many payment applications or accessing a particular URL uh for example uh U accessing a menu in a restaurant nowadays you see a QR code plac and we need to scan.
Jessica Selvin
That to access their application or their menu uh right so these are some of the key places where we need to open up our cameras and uh process a particular image or capture an.
Jessica Selvin
Image right uh or even in terms of creating a profile picture for any account that you're creating on the application uh uploading a selfie uh and uh your profile picture and.
Jessica Selvin
So on so um having media media comes into play in almost any of your workflows or actions that you're doing in applications again live streaming if you are a media based application live streaming.
Jessica Selvin
Of videos ensuring that the quality and all the other functionalities are seamless uh and so on so these are some of the key places where we see uh media injection uh come into play.
Jessica Selvin
So now when it comes to testing these applications right uh with these functions be it now we've touched upon some of the key uh features.
Jessica Selvin
Right OCR uh biometric authentication and media injection now to ensure that we are testing these applications in real time clicking images or U.
Jessica Selvin
Actually doing a biometric authentication uh to do testing for this of would typically might require actually you procuring an actual device and to be physically near it in order to test it.
Jessica Selvin
So and scaling up this kind of testing would be really expensive uh you need to have a range of devices and that's going to be expensive timec consuming and ineffective.
Jessica Selvin
So to uh I'll be showing how through Pcloudy and on our public cloud platform how we enable users to test for media injection for OCR as.
Jessica Selvin
Well as biometric authentication and um with that uh I will just go into the live demo to Showcase how it works how it all works on our platform.
Jessica Selvin
So yeah um just to give a quick introduction about our platform Pcloudy is a unified app testing Cloud platform where uh we provide you uh a range of solutions for your application testing.
Jessica Selvin
Right uh be it in terms of uh test creation where we have an automation engine where you can create your test scripts in a low code no code fashion secondly we have comprehensive test.
Jessica Selvin
Infrastructure where we have a broad range of devices be Andro um mobile devices as well as browsers um Android iOS um Mac and windows machines.
Jessica Selvin
Right uh where you can test your mobile web applications even desktop applications and so on and also we have a test management solution where you can track Milestones assign tickets and track um your.
Jessica Selvin
Project plans and so on so with that introduction let me get into the specifics of the features that we had uh discussed.
Jessica Selvin
Right so firstly uh yeah let me just show the our devices so this is are uh public Cloud platform and these are our devices that are real devices that are hosted across in our.
Jessica Selvin
Data centers right uh so before I acquire a device and start my testing uh one of the prerequisites is to ensure that uh all the files that are related to your testing are uploaded.
Jessica Selvin
So uh this is the my app data section and we need to ensure that the application that I'm testing and any image Associated image that I need to upload during my testing is uploaded.
Jessica Selvin
In this section right so firstly let me talk about uh the image injection and the OCR piece of it.
Jessica Selvin
Right so um yeah this is my sample OCR application I have just clicked on upload file and you can just browse through your machine and upload uh the relevant APK or application and.
Jessica Selvin
So once you have uploaded your application there is a small uh prerequisite or a step that you need to do uh where you need to click on this icon here and instrumented for image.
Jessica Selvin
Injection so what this will do is it will add relevant libraries um and ensure that the image injection functionality works when you're testing.
Jessica Selvin
So it will repackage the application rename it and as you can see uh uh underscore image injection.
Jessica Selvin
APK so this will be the file that we'll be using for testing right uh it's similarly similar kind of uh authent uh instrumentation will be done for biometric authentication as.
Jessica Selvin
Well uh let me just show that yeah so this is our sample application for Biometrics uh so again we need to click here and um instrument it for biometric authentication.
Jessica Selvin
So once I do this uh it will rename it uh and repackage the application such that it's suitable to test for biometric authentication.
Jessica Selvin
So once we ensure that firstly my application is uploaded uh I have instrumented it for the specific function right be it image injection or biometric authentication uh and thirdly any particular image the ID.
Jessica Selvin
Or the check or the image of the check right for example the IDS or the passport image all these are.
Jessica Selvin
Also uploaded into the section so this is the pre-requisite we need to ensure uh before we begin our testing.
Jessica Selvin
So now I will just go ahead and acquire a device we'll just give it a minute to access yeah.
Jessica Selvin
So now I have complete access of this device right so now I will go ahead and install um the sample applications uh for showcasing each and every one of these features.
Jessica Selvin
So firstly let me just show the image injection part so uh note that these applications are just sample applications they are developed just for showcasing these features um.
Jessica Selvin
So let me just install the application to test for image injection right so I will choose an image that I want to get injected.
Jessica Selvin
So here is just a sample image of a check and when I click on take picture and the camera opens.
Jessica Selvin
Right instead of the image that or these devices are in the data center so clicking an image there U uh instead of clicking the image or the surroundings there uh it has injected this.
Jessica Selvin
Image that I have injected the sample blank check and that would be visible for you to see right so this is how image injection works.
Jessica Selvin
Now let us see how this plays into uh the OCR feature so I will install the sample application for OCR.
Jessica Selvin
Yeah so it has been installed uh now again I will maybe choose another image so I will choose an emir's ID image here.
Jessica Selvin
Right and I will go to the [Music] camera and once I click on this image here and click on.
Jessica Selvin
Okay so instead of the actual image that was clicked this particular ID would be injected at that point and it will be able to test and take the image instead.
Jessica Selvin
So once I select the required area or my preferred area and I give a crop as you can see this image has been converted to the relevant text.
Jessica Selvin
So the nationality uh the ID number the name uh and the country and so on right uh let's just test for a couple of more images maybe.
Jessica Selvin
So I have selected a passport image here we will follow the similar steps so again as you can see the um the passport image has gotten injected in place of the camera click.
Jessica Selvin
Right so as you can see uh it has extracted the text and you can see the name nationality place of birth and we'll be able to extract this information in the form of text.
Jessica Selvin
Once we do that um so this is how OCR uh Works um finally now talk moving on to biometric authentication.
Jessica Selvin
Right uh I will go ahead and install the Apple application for biometrics yeah so again this is just a sample application to just test for that functionality.
Jessica Selvin
So once I click on authenticate here right I can go to the touch ID option here and test for both past as.
Jessica Selvin
Well as failed scenarios so uh now if I click on past here you can see that I've logged in successfully with the biometric.
Jessica Selvin
So what is happening here in the back end is it's simulating a valid response and giving it uh at the prompt and it'll be able to log in successfully.
Jessica Selvin
Now if you want to test for a fail scenario uh we can do that as well right so as you can see it has not moved on to the.
Jessica Selvin
Next page and it has taken it back to the previous page so you will be able to test for positive as.
Jessica Selvin
Well as the negative or failed scenarios um in terms of biometric authentication and this feature is available both in Android as.
Jessica Selvin
Well as uh iOS devices so uh with that that is a quick uh summary of uh all the three features that we've talked about.
Jessica Selvin
Also to add on uh you will be able to also um uh and hear the audio output in case for testing media applications and.
Jessica Selvin
So on you'll be able to hear the audio output as well um so this summarizes uh some of the key functionalities and how Pcloudy is enabling users to test for be OCR injecting images.
Jessica Selvin
Uh in the workflow of testing your applications as well as authenticating your uh application bya uh Biometrics and enabling your testing for that.
Jessica Selvin
So uh with that I I think we can uh take up the questions now so uh if there are any questions on the chat please leave them on the chat.
Jessica Selvin
Right uh so one of the questions that I can see is can we use use OCR extraction in automation.
Jessica Selvin
So uh yes we can uh uh in terms so this is mainly in terms of image injection that's what we're talking about.
Jessica Selvin
Right we can do the same we can script this uh in our APM scripts and we can uh test for image injection in our APM script.
Jessica Selvin
So that is possible yes so there's another question that I see uh is there a facility to do video injection yes.
Jessica Selvin
So while this is not mainly in production uh this is there uh in um you can customize this feature and this is definitely a doable um feature that we can bring in.
Jessica Selvin
So these are open source libraries if you're talking about uh OCR uh features right uh um so one other question that I see is are these libraries internal or open- Source libraries um these.
Jessica Selvin
These are open source libraries so for Touch ID will it work on automation as well yes so again in for Biometrics.
Jessica Selvin
Right we have there are apis in APM uh for which it will work in your automation scripts or your APM uh scripts as.
Jessica Selvin
Well any other questions so is there any feature for bulk injection uh or uploading multiple images so again this might have to become a customized feature we would need to.
Jessica Selvin
Look into the specifics of the use case but this is something definitely we can uh get back to you on um.
Jessica Selvin
So for iOS apps do we need to instrument the app as well yes we need to instrument including for iOS applications uh does media files support multilingual or translations.
Jessica Selvin
Right uh so yes uh if your application supports different languages and translations if your application that your testing uh supports that.
Jessica Selvin
Then Pcloudy will be able to enable that can we test the performance as to how much time it is taking to authenticate.
Jessica Selvin
So um we are not much into response time and so this is mly more from a functional testing point of view.
Jessica Selvin
Right so uh checking response times for a single action um may not uh be immediately possible but that is something definitely we can.
Jessica Selvin
Look into do we need to change anything on our code for Biometrics to work on Pcloudy so yeah just including those apis.
Jessica Selvin
Right which again uh definitely we can uh share back to you um so having that uh incorporated into your script is what will enable biometric authentication uh can we automate the cropping size for.
Jessica Selvin
Example I uploaded an image and want to extract on specific coordinates yes again this should be possible in the automation scripts by specifying the coordinates um this should be possible yes if few respective.
Jessica Selvin
Mobiles are not available in the list what should I do so um I'm not sure if you're referring to whether the device is busy or the device is not available at all.
Jessica Selvin
So so uh for popular models we do have multiple devices of the same make um but if you're referring to it being busy uh and if there's only a single model of that device.
Jessica Selvin
Then and if you're using the public Cloud so in if you're going for private Cloud you will have full access to uh the devices and no one else would be able to access those.
Jessica Selvin
Devices if you're using private Cloud but if you if I'm talking from a public Cloud standpoint uh you would need to wait till the devices are released and on average we see that it.
Jessica Selvin
Takes Tak about 45 minutes for a device to be available again so I hope that answers the question um.
Jessica Selvin
Also I see another question do we need any specific compatible tools to automate all types be it web desktop mobile and backend apis.
Jessica Selvin
So um we don't need any specific tools so in terms of if you're referring to our codeless automation right um we do not require.
Jessica Selvin
So there are certain prerequisites where you need to have an agent installed uh but apart from that there are no uh other tools these are small executable files but these are not other tools.
Jessica Selvin
That are required our platform itself would be able to handle all these different types of applications um do we have devices like tablets and iPads yes we do have those devices yes in private.
Jessica Selvin
Are all devices available so that would depend on the licensing and this would have to be a customized plan.
Jessica Selvin
Right we can definitely discuss please do we will reach out to you or you can reach out to us and uh we can discuss what type of devices are on priority for you and.
Jessica Selvin
Um, uh, fix on a plan, a customized plan in terms of for private cloud.
Dinakar
Well uh, looks like a lot of questions coming your way Jessica, I'm sure it'll take all night, were to.
Dinakar
Answer them uh I think I think we should maybe do one more and then probably conclude and we can answer those questions offline as.
Jessica Selvin
Well sure sure maybe another question which you think uh will be more relevant right uh yeah again if this is about a live video in Chrome browser.
Jessica Selvin
So right now uh we are using media injection primarily in the U for mobile applications so for browser again we would have to check it could be a customization that might have to be.
Jessica Selvin
Done or um but currently this is mainly in uh mobile applications where we are doing media injection so I think that is about it.
Dinakar
Right well Jessica you've been a you've been a superstar in answering so many questions in such a short time.
Dinakar
So kudos to you and we really want to thank you for sharing this valuable information with us you had used a lot of practical examples and shared the real world scenarios with us.
Dinakar
So and your presentation was has covered a lot of practical movements within various Industries uh in this space so we want to really thank you.
Dinakar
So much for giving your time and sharing with our audience here we also want to thank each one of our participants we.
Dinakar
Also want to thank each one of our participants who taken the time uh on a you know on a Wednesday evening and been here to listen to us on the webinar and we sure.
Dinakar
We're sure that the webinar has sparked a few ideas it is drawn in a few interest in OCR media testing and biometric Authentication.
Dinakar
So if you do have any questions uh please do reach out to us uh you can use the chat option on our website or you can write to us at info@ Pcloudy do.com that's.
Dinakar
INF NFP cloudy.com and we'll get back to you we'll converse with you further um so yeah thank you thank you once again for being an engaging audience this is one of the highest number.
Dinakar
Of questions that we've got at webinars so we really want to thank you for being such a lovely audience today uh good day to each one of you thank you everyone.
