Links from Bikram Kawan - xAPI and Assessment

• The Miro notes from this session 
• Connect with Bikram on LinkedIn

Automatic Transcript of Bikram Kawan - xAPI and Assessment

[Bikram - Sprout Team] 12:32:15
Hi everyone, thank you so much for joining today and thank you for introduction Robin.

[Bikram - Sprout Team] 12:32:22
I hope you are having a good time throughout the session.

[Bikram - Sprout Team] 12:32:25
Earlier this morning, and there are plenty of interesting sessions in the pipeline. So as Robin said I've been working with Robin. For more than four years and I'm working as software engineer at Sprout labs.

[Bikram - Sprout Team] 12:32:38
Today I'm going to discuss a bit more on next MPI and how it can be used in assessment.

[Bikram - Sprout Team] 12:32:50
Okay, so here's your highlight for today's session I have highlighted on what you are going to get from the session. I will talk on quick introduction about what is except di why you should be using, and a sock comparison and accept PR which comb and

[Bikram - Sprout Team] 12:33:04
elements in assessment. Then after I will so on how it works for the course, and the non course did also. And finally, our discuss and yx APIs important assessment in different aspects means basic examples.

[Bikram - Sprout Team] 12:33:24
And this is not going to vary Dickie presenters and it's very simple, I think so. In chat.

[Bikram - Sprout Team] 12:33:36
Could you please share what you know about exit BI.

[Bikram - Sprout Team] 12:33:39
I will pause for a second.

[Bikram - Sprout Team] 12:33:41
Up.

[Bikram - Sprout Team] 12:33:46
Nothing. Okay.

[Bikram - Sprout Team] 12:33:51
Nothing.

[Bikram - Sprout Team] 12:33:51
No, it is not an alternative to lm s.

[Bikram - Sprout Team] 12:33:56
What I know about x API.

[Bikram - Sprout Team] 12:33:59
Not at all okay this is new.

[Bikram - Sprout Team] 12:34:07
Basic this very little arcane magical quote but yeah it's a magical code, couple of lines, and you can get a lot from them.

[Bikram - Sprout Team] 12:34:14
Experts applicant brand new interface. Yes.

[Bikram - Sprout Team] 12:34:17
Okay, I think most of the people don't know actually what is except PR and some people are does no be. So, I will give a bit of introduction.

[Bikram - Sprout Team] 12:34:35
So, what is x API, actually.

[Bikram - Sprout Team] 12:34:40
It's very simple. It's a long specification on capturing learner adverse experiences.

[Bikram - Sprout Team] 12:34:45
It can be either online or offline. It is often called Experience API. Some people might prefer to say experienced API or some people just can say, simply accident but both are saying.

[Bikram - Sprout Team] 12:34:58
It is called expert Experience API as it collects our learners different experiences, by space because it makes it easier to communicate with different platform, isn't it.

[Bikram - Sprout Team] 12:35:10
So, it has evolved, due to the limitation of scope scope has very limited and gathering data and also hard to interpret, even though. After collecting the data and exit that provides different ways to collect data, and in x API, it is us who can tell

[Bikram - Sprout Team] 12:35:29
what type of data needs to be collected on Lorna's experiences.

[Bikram - Sprout Team] 12:35:34
And in.

[Bikram - Sprout Team] 12:35:38
So in Laura's experience behavior or storing data object report as statement. When we often your statement.

[Bikram - Sprout Team] 12:35:45
While talking about x API so it probably might are more word statement rather than x API, while working with x API.

[Bikram - Sprout Team] 12:35:56
And data in XML represented in JSON format, which is often called JavaScript objects in tax. And this is an example of how x API statement in the amazed in JSON format.

[Bikram - Sprout Team] 12:36:09
So you can see actor verb, object. I was taught this in more detail.

[Bikram - Sprout Team] 12:36:15
And once the data are being generated it tended to be scared. It's very simple. Once the data are being generated. We need a place to store, which is often call us learning record store or simply LRS and learning record store is us.

[Bikram - Sprout Team] 12:36:31
It's just a simple log store all week we can say like a data warehouse we often call data warehouse awesome.

[Bikram - Sprout Team] 12:36:42
And the data are being sent to that data warehouse to API.

[Bikram - Sprout Team] 12:36:46
And API is the protocol dot between two different technologies.

[Bikram - Sprout Team] 12:36:54
Thanks for that link.

[Bikram - Sprout Team] 12:36:55
So here is an example of Lorna Sally said experience solo hang gliding. If you break down this experience. A Sally is an actor, or let's say learner, or in other way.

[Bikram - Sprout Team] 12:37:09
Laura experience is verb and hang gliding is object. Let's have a look into more detail on Stedman companies,

[Bikram - Sprout Team] 12:37:18
not by default model capture, except bi, we need a plugin. Yeah.

[Bikram - Sprout Team] 12:37:26
So, except you have three major components which are actor verb and object, actor are often like Sally, or refer as learner, Bob is described what happened with Laura and Object, and Object is activity like are the course, or course activity like quizzes.

[Bikram - Sprout Team] 12:37:46
True or False question, any feedback questions. And there is often the field, which is not required to form a statement but could be useful for different purposes, we can track lawless timestamp of competition, which are like pass or fail and context

[Bikram - Sprout Team] 12:38:06
And the second images of Stedman is being sent to the REST API.

[Bikram - Sprout Team] 12:38:09
which might be quite useful place where we can store, awesome data.

[Bikram - Sprout Team] 12:38:16
I'm just reading the chat.

[Bikram - Sprout Team] 12:38:19
Thanks for the link, link.

[Bikram - Sprout Team] 12:38:23
And this is a certain scenario where we can use x API in different ways.

[Bikram - Sprout Team] 12:38:28
Are we can connect with any alternatives tools elements, social platform mobile apps or anything other you want, and we can use like a nor are we can use x API normal web application also.

[Bikram - Sprout Team] 12:38:43
So why is why you should be using x API.

[Bikram - Sprout Team] 12:38:49
So x API is based on modern technology, which is very easy and fast to work with, with any kind of technology.

[Bikram - Sprout Team] 12:38:57
It can be worked with either legacy, or modern application also with very easy,

[Bikram - Sprout Team] 12:39:03
smart decision, so we can make smart decisions based and learner completed activities within means we can make a decision based on data driven approach, as we can track learner micro experiences.

[Bikram - Sprout Team] 12:39:16
For example, if a learner have completed a course called index and we can recommend other courses like how to improve remote working after finishing the induction course

[Bikram - Sprout Team] 12:39:28
are recording. As I mentioned earlier, x API is so flexible, it is us would define what to record data, we can record, Laura, any experiences, it allows different ways to record data, we can even record custom data for our custom application

[Bikram - Sprout Team] 12:39:47
business this is an

[Bikram - Sprout Team] 12:39:52
X API is written data collected from various learning experiences, we can use that data for different analytics purposes, and based on those results we can make our business decision.

[Bikram - Sprout Team] 12:40:08
So I'll give an example, let's say there's an induction course happening. And we can see how the people are doing the course.

[Bikram - Sprout Team] 12:40:12
And how long they take time to finish

[Bikram - Sprout Team] 12:40:16
that core so are we can also find which part is not interesting for the learners.

[Bikram - Sprout Team] 12:40:22
Through these you can make decision to improve our course or course component to improve the learner performance

[Bikram - Sprout Team] 12:40:30
integration.

[Bikram - Sprout Team] 12:40:32
Thanks x API is based on modern technology, the integration is boundless which means it can integrate with any sort of platform through API. It can be easily integrated with our BI tools as our system and other reporting application.

[Bikram - Sprout Team] 12:40:48
I'll give an example of this. Later on the presentation from our simple use case.

[Bikram - Sprout Team] 12:40:54
So here is the simple table for comparison between how x API, x calm and lm s and assessment works.

[Bikram - Sprout Team] 12:41:02
x API can collect data from anywhere was calm and elements is mostly limited on SMS only, and x API is able to record any type of data was gone can record some interaction, but mostly competition on elements, mostly course competition is being recorded,

[Bikram - Sprout Team] 12:41:17
reporting on x API is very flexible you can define custom headers, whatever you want, was comb and elements are limited to predefined CSP integration on x API can be done with any platform with easy, but scope and elements are limited, and on CSP, which

[Bikram - Sprout Team] 12:41:41
means you need to import them manually.

[Bikram - Sprout Team] 12:41:47
So, I would like to so how x API work in action.

[Bikram - Sprout Team] 12:42:02
In one of our example, so I'll just go to the live site where we are using it. Okay, so, so now we have some our evidence of x API now I would like to so how an accent work in our course.

[Bikram - Sprout Team] 12:42:12
So this is the base which consists different type of activities. It is based on our glasses product, but very similar to other elements platform we support different type of question.

[Bikram - Sprout Team] 12:42:25
I'm just reading a comment on no it doesn't have to be a new feature.

[Bikram - Sprout Team] 12:42:32
Also you. I think after I saw this, the base and David will have bit more idea.

[Bikram - Sprout Team] 12:42:39
So lm s platform obvious support different type of executed through force drag and drop and feedback so in this space we have a first one is execute.

[Bikram - Sprout Team] 12:42:49
And these have legitimate user can select single answers. And this is also execute with different layout, just to make different portfolios, and this is also execute where you can select drop down.

[Bikram - Sprout Team] 12:43:04
And this is interactive devil.

[Bikram - Sprout Team] 12:43:11
These are again select their answers. And this is different type of MC curve where user needs to be select multiple choice questions, multiple answers.

[Bikram - Sprout Team] 12:43:20
And this is the reins.

[Bikram - Sprout Team] 12:43:23
And this is close.

[Bikram - Sprout Team] 12:43:27
And this one up like a feedback. Feedback type of questions.

[Bikram - Sprout Team] 12:43:32
And we have drag and drop.

[Bikram - Sprout Team] 12:43:37
Like this. Keen and granting scenario.

[Bikram - Sprout Team] 12:43:42
Yeah, so we have decided like some of the questions type, we have in our class after class has asked if you compare this in other lm s platform you might have very similar like MCQ and other different diversities while I'm doing this answers are the data

[Bikram - Sprout Team] 12:43:58
data is being recorded in the background. I will see at. So in an example so let's say our pretend as a learner and going to answer the question the sandwich, Ireland are known by the name today.

[Bikram - Sprout Team] 12:44:10
So I'm going to select Marshall Islands.

[Bikram - Sprout Team] 12:44:12
It is incorrect. Let's see how data is being sent to the data warehouse or learning record store I'm just going to refresh so I just answer. This is like a previous one with ID to this is a recent one.

[Bikram - Sprout Team] 12:44:26
So this is how the data is being stored so you don't need to be very.

[Bikram - Sprout Team] 12:44:31
It looks scary but not had all.

[Bikram - Sprout Team] 12:44:34
So if you remember the ex FBI slide before for the statement or if you search for the first component which is actor, an actor, we can see my name be chrome colon and email address.

[Bikram - Sprout Team] 12:44:48
Let's see, a second component which is or service answer I answered that questions. Let's see the object, third component. So this is the object and in object we can see the which question has been answered.

[Bikram - Sprout Team] 12:45:03
And this is the same questions.

[Bikram - Sprout Team] 12:45:06
And these are the three crucial component which is required for generating x API, but in class as we've been tracking, other things like user browser thing.

[Bikram - Sprout Team] 12:45:17
And also we do track.

[Bikram - Sprout Team] 12:45:36
So let's let now why it is correct. Our just refresh this minimized and now just rephrase and their accounts. Now the data.

[Bikram - Sprout Team] 12:45:45
Minimize and now just refresh and there comes another data. And if you search for response. Now, we can see how why, and the result is success and we get some score.

[Bikram - Sprout Team] 12:45:53
So we can define how the score and other things.

[Bikram - Sprout Team] 12:45:57
Depending on our application.

[Bikram - Sprout Team] 12:46:00
So this is how

[Bikram - Sprout Team] 12:46:05
x API data can be tracked so we do we can track like any kind of activities, even though like scrolling the base, like you know, our learners have viewed multiple choice question, take that apply block.

[Bikram - Sprout Team] 12:46:17
So, it is up to us like how how and what did I need to retract.

[Bikram - Sprout Team] 12:46:24
Okay, Let's go back to the slide.

[Bikram - Sprout Team] 12:46:28
Now, just to continue.

[Bikram - Sprout Team] 12:46:35
Okay, now the use of x API is not limited and course only.

[Bikram - Sprout Team] 12:46:42
There are a lot of evidence is.

[Bikram - Sprout Team] 12:46:49
I'm just going to pause for a second to read the comments.

[Bikram - Sprout Team] 12:46:59
Yes we can track the How many times will order to try to answer that question also, I will so you that thing in the letter on the slide of why in the assessment area.

[Bikram - Sprout Team] 12:47:08
So I will continue my presentation.

[Bikram - Sprout Team] 12:47:10
So there are a lot of evidences, it has been used in non course use cases. I will go through a couple of use cases.

[Bikram - Sprout Team] 12:47:17
To give an idea.

[Bikram - Sprout Team] 12:47:19
So first, I want you to use in your ischemic tourists coming out against beyond the purpose. You see him from Spain, have developed different games, but there is an image from one of their game to train students with intellectual disabilities, and how

[Bikram - Sprout Team] 12:47:35
to move around major city dirt tracking player health position progress and other information in x API Barb's used in this game or interact use one object can be tracked of the action.

[Bikram - Sprout Team] 12:47:52
Verbs used in this game or interact use one object can be tracked of the action. So you can check more about the information from that link.

[Bikram - Sprout Team] 12:47:58
x API is being used in different simulation also have picked one interesting example for this, the Air Force from USA is using except VR for capturing data from the simulators, they capture data and analyzed for benchmarking their application.

[Bikram - Sprout Team] 12:48:16
And also, they've been using x API for testing and evaluation.

[Bikram - Sprout Team] 12:48:21
Also it is very easy to analyze the user behavior, without exposing or accessing the personal data, and they believe that they have said diamond capturing information of itself and and debriefing trainings, missing for the assessors

[Bikram - Sprout Team] 12:48:39
neither one is held. So this one is taken from his case of water set for met star health. They have developed the defibrillator doctrine or app, the different result is a device to send electric falls to the heart to restore normal heartbeat.

[Bikram - Sprout Team] 12:48:56
So they get their various loner experience over the epic isn't it helped him to analyze finding how the clinicians are performing.

[Bikram - Sprout Team] 12:49:06
Have they finished all the assessment. What are the hard part of the assessment, and also improve the performance.

[Bikram - Sprout Team] 12:49:13
I had put on a link to that slide.

[Bikram - Sprout Team] 12:49:17
So in chat can please share some non course data which can be useful for access API.

[Bikram - Sprout Team] 12:49:26
If you have ever known, or can be used in the scenario.

[Bikram - Sprout Team] 12:49:37
Yeah. And, of course, as Lynn said this is free. We don't have to pay anything for performance, we just, yes.

[Bikram - Sprout Team] 12:49:52
Didn't good learning summit, that's a nice one fan. Thank you.

[Bikram - Sprout Team] 12:49:59
Workplace experience undergraduate task.

[Bikram - Sprout Team] 12:50:07
Okay, I will.

[Bikram - Sprout Team] 12:50:10
So it can be used in other places also BB eight and unless it is introduced implies.

[Bikram - Sprout Team] 12:50:19
Yes we can track what point 14% and user dropout. Yeah.

[Bikram - Sprout Team] 12:50:25
So, we need to defined

[Bikram - Sprout Team] 12:50:28
in your application. Devin mid 400 comments Adam is a good one.

[Bikram - Sprout Team] 12:50:34
Yeah, so it can be used in any purpose so it's just like a normal English sentence.

[Bikram - Sprout Team] 12:50:41
So all the talk. Why yx up is an important in assessment now.

[Bikram - Sprout Team] 12:50:49
So, first important is leveraging analytics and evaluation for the course, since x API is data is it can be used for capturing anything, it will be useful for doing several analytics and valleys and based on that data, we can improve performance have

[Bikram - Sprout Team] 12:51:05
best activity data can be useful on redesigning refresher training course or simulation example, we have a cybersecurity course or less, which needs to be done every year based on how we are tracking data we can find.

[Bikram - Sprout Team] 12:51:21
How long, Laura spent time for that course, our money fails. And what are the hardest component for that course.

[Bikram - Sprout Team] 12:51:32
Best Sunday's, we can improve

[Bikram - Sprout Team] 12:51:34
course content and make more engaging for the learners. This applies to symbolize and also like why most people are failing on step x.

[Bikram - Sprout Team] 12:51:44
So here is an example I have taken from a question from our one of our use case, there Laura is asked a question.

[Bikram - Sprout Team] 12:51:54
assurance containing the diamond be too well for the using treating headaches. I'd start to There are five of sons.

[Bikram - Sprout Team] 12:52:07
And,

[Bikram - Sprout Team] 12:52:07
and Laura nice to select one single answer.

[Bikram - Sprout Team] 12:52:11
So, an honest answer for this question is being tracked for this question, there were like 52 loners participated and hundred and 71 records were produced.

[Bikram - Sprout Team] 12:52:23
So the correct responses were around 62% is only an hour 5732 37 user attempted more than once, for passing this particular question Andre, so as you can see in the at the bottom of this right picture you can see a user ending be answered.

[Bikram - Sprout Team] 12:52:45
Five times to make to get the correct answer.

[Bikram - Sprout Team] 12:52:50
So, this, and this is the same window, of which I just showed earlier, but from the, so this is the one so like this so I called incorrect, I gave the incorrect answer here and got the correct answer here.

[Bikram - Sprout Team] 12:53:08
Continue.

[Bikram - Sprout Team] 12:53:12
And second, secondly, integration integration with x API is not limited to a platform, it is easy to integrate, we can forward all the experiences or lettuce statement to other platform, which is quite useful for other application to make decisions based

[Bikram - Sprout Team] 12:53:38
on Lauren experiences, may have been successfully using this approach for a couple of clients as Sony image for one of our blind we are forwarding statements associated with different products like access competition and started, and we've been based

[Bikram - Sprout Team] 12:53:48
on those work we have set up an automation for adding against the competencies to cybersecurity course based on access for and sending out the competition base and of course competition for sending manager when Lorna start the unit, based on started for

[Bikram - Sprout Team] 12:54:06
sending email to manager when Laura completed the unit best incompetent for and you can also even assign a task to the learner base and anymore. It doesn't have to be accessed, but it can be a different way.

[Bikram - Sprout Team] 12:54:19
So these are the right hand side is the glass house one and the left hand side, the statement forwarding is from the learning locker one.

[Bikram - Sprout Team] 12:54:34
It will also set cost if we can integrate exit BI platform, or let's say lonely record store with any other application so mostly we can integrate, Mrs.

[Bikram - Sprout Team] 12:54:51
With as our system and BI tools, this, this, this way, it will save human time for updating records on its are are BI tools, or any other platforms and wants to learn or completed a course or something, then it can automatically update on our system or

[Bikram - Sprout Team] 12:55:05
know it can live. See the data in the BI tools.

[Bikram - Sprout Team] 12:55:11
So it says a lot of time.

[Bikram - Sprout Team] 12:55:16
Think on the job assessment is another aspect, we were able to analyze employee log like location where they did the assessment, who is Jerry assessor and adding evidence and time when they finish the training.

[Bikram - Sprout Team] 12:55:30
It is easier to make decision based on data, often if your training is integrated with other platform, or the application can make quick decision on if the learner is pass or fail.

[Bikram - Sprout Team] 12:55:42
So this means assessor doesn't need to go through all question we start right or wrong. to make are marked as complete for that specific learner.

[Bikram - Sprout Team] 12:55:54
And lastly, it is possible to remove human error which needs to be transferred to HR system of the assessment record.

[Bikram - Sprout Team] 12:56:02
Like, if a little Sally had finished the induction training and it needs to be updated and it's our mean traditional ways to update that thing record in HR, but through the integration of LR is I mean, you can essentially automate that things very easily,

[Bikram - Sprout Team] 12:56:16
and which saves time and also it removes the human error, which we normally get a lot of our in our system.

[Bikram - Sprout Team] 12:56:31
So in chat Can you please share what would takeaways from the session and if you have any questions, please write in the chat.

[Bikram - Sprout Team] 12:56:53
Yeah. And also, the learning locker GIFs has in the dashboard for like simple bar chart online online chart you can use that thing very easily. You don't have to use the bar beer in for a complicated thing you can definitely use bar via.

[Bikram - Sprout Team] 12:57:12
Yeah.

[Robin Petterd - Host] 12:57:16
Yes.

[Robin Petterd - Host] 12:57:20
No.

[Robin Petterd - Host] 12:57:23
Natural fact there was a big room wanted to focus most of the session are actually doing that exact task and I I went all this is still going to be more broader

[Bikram - Sprout Team] 12:57:36
might be nice follow up, follow up actually pick up from the young, the How does a track guy. Yeah, because people are kind of thinking that is doing, out of box or doing some magic.

[Bikram - Sprout Team] 12:57:50
And in Moodle.

[Bikram - Sprout Team] 12:57:57
We have a blogging x API and it does when we do install that plugin and add some credentials, it will automatically start capturing the information like MCC equation increases and the confidence for us and any enrolled thing happening in the middle.

[Bikram - Sprout Team] 12:58:12
I like the learning, learning local grass Yes, we use that more often and we've, so far we don't have to use any like complicated, it gets out of the most.

[Bikram - Sprout Team] 12:58:21
And you can also use the filter to create a nicer graph.

[Bikram - Sprout Team] 12:58:29
I can misery.

[Robin Petterd - Host] 12:58:32
Question from Phil, the Chrome.

[Bikram - Sprout Team] 12:58:36
Okay. Um, so, how can I measure a general statement for a given interaction. So if I go and go back a bit more on focus on this first question let's say we have in

[Bikram - Sprout Team] 12:58:54
our, in our so in, in our, in code base, or let's say, in our glass house, we have a component, which does generate MC question. and what we are doing is we are adding an event to the JavaScript, when user clicks on this one.

[Bikram - Sprout Team] 12:59:14
It will say, generate adapter read the, the things which is in the text, and then just add that things into the statement so I'm not sure if I can make that understand, because we're human language.

[Bikram - Sprout Team] 12:59:31
So basically what it's doing is, if we do like this so over here. It is the same, except dr Stedman serves and if you're going to, if this is kind of bit more technical Yeah.

[Bikram - Sprout Team] 12:59:42
So over here we are sending like this kind of information. So this is generated by JavaScript.

[Bikram - Sprout Team] 12:59:48
And this is being stored in the morning elaborate story.

[Bikram - Sprout Team] 12:59:52
And this is this is the standard.

[Robin Petterd - Host] 12:59:56
To answer your question in a different way and you think they can do this in a way where I've sent something technical. So we've got a big rooms. So reason for storyline actual custom code for doing this as well.

[Robin Petterd - Host] 13:00:10
So reason for storyline actual custom code for doing this as well. So yeah, I think one of the nice things about about when we're working with all existing in our- in glass house but when we, when we're working with clients with within the storyline, it has to be more custom.

[Robin Petterd - Host] 13:00:21
Yeah cool, thank you Bikram! Awesome job.

[Bikram - Sprout Team] 13:00:22
Thank you so much. Thank you so much, everyone.