Home › Content library › The Assessment Summit - Recordings › Cara North - Creating Measurable Assessments in L&D

Cara North - Creating Measurable Assessments in L&D

 

Links from Cara North - Creating Measurable Assessments in L&D

Automatic Transcript of Cara North - Creating Measurable Assessments in L&D

[Cara North] 12:01:28
Thank you so much I am actually Cara North I live in Columbus, Ohio in the United States but today I'm joining you from fabulous

[Cara North] 12:01:44
Las Vegas, Nevada at the Adobe learning summit So I did that this morning and now I'm here with you all talking about assessment which is one of my favorite topics and I've loved all the presentations.

[Cara North] 12:01:56
Up to this point.

[Cara North] 12:01:58
So just tell you how we're going to spend the next 30 minutes together and I was really sad, it was just 30 minutes because there's so much we could talk about.

[Cara North] 12:02:06
I just talk a little bit about assessment one on one really break down. I know that there's been a lot of sessions you know Jenny did a great job of highlighting some of the pitfalls of using multiple choice, Ray also mentioned the great things about

[Cara North] 12:02:19
scenario so just talk about the difference between those. And then we're going to spend most of our time just about ways to develop that our assessments and then my favorite part turning it over to you for questions and answers.

[Cara North] 12:02:34
All right. So, one big thing that bothers me about assessments in general is that I think too often, the assessments that we're providing our users are often written so poorly, that people can do this stuff called guests the correct answer.

[Cara North] 12:02:53
Okay, so I think so often assessments actually measure deduction skills and not content knowledge of what it is that you are trying to provide them, guidance on in your learning experiences that you develop.

[Cara North] 12:03:09
So one thing I want you to be thinking about in the next 30 minutes together and honestly this is probably something that's worth thinking about for the rest of this amazing summit is, you know, what does it actually mean to know something, right, so

[Cara North] 12:03:20
what does that actually mean, kind of, in, in the wild. I just want you to be thinking about it, not saying you have to answer it, per se, but I just think it's something to consider.

[Cara North] 12:03:30
So to kick it off. I am. I hope you all don't mind, would you all like to play a game with me, hopefully, hopefully, okay. So I have this theory again that so many assessments, you can guess the correct answer without knowing the content so we're going

[Cara North] 12:03:47
to actually put that to the test alive right now. And so what I'd like for you to do, and I apologize, the zoom bar is in the way but is there a link.

[Cara North] 12:03:58
Let me see if I screw this other way. Hang tight year.

[Cara North] 12:04:01
Yes. Okay, so if you go to aha slides.com slash as Kara some assessments on it Kara, you should be able to get in here, and I'd love for you to play along with me live is just going to be for questions.

[Cara North] 12:04:13
And I'm going to see because I have a theory that you're going to be able to guess the correct answer so I see a couple of you are logged in, I'll wait a few moments for the rest of you, bi i think that i think you're going to be surprised that you're

[Cara North] 12:04:27
going to be able to get a lot of these right, and please pick your favorite emoji. I love seeing people's different emojis.

[Cara North] 12:04:35
I will David's a wizard, Alicia is an astronaut, I love that Iggy I'm filling the elf.

[Cara North] 12:04:42
Danielle Lisa Jen just happy loving life, love it, love it, love it, Maria. I love it I'm a gamer myself. Yes. And you can also share a mo geez through this, so this aha slides as Kara, that actually also gives you a copy of today's slide deck.

[Cara North] 12:04:58
Okay.

[Cara North] 12:05:08
10 is a squirrel.

[Cara North] 12:05:09
All right. Robin I love cats too. So, I totally get that way. When I see my cat Cora is a unicorn I love.

[Cara North] 12:05:10
Sushi is an alien love it. Okay. All right, I'll just wait a few more moments for folks to get in because you will have a fear of missing out if you don't get in on this let me tell you it's gonna be so much fun.

[Cara North] 12:05:21
All right.

[Cara North] 12:05:24
All right, I'm just I'm loving the variety of emojis I have just in all i love it love it love it. Okay. And also just side plug this is not sponsored by aha slides I recently found them a couple months ago and they're my main presentation tool now because

[Cara North] 12:05:39
I love that it captures data and it captures like what people put into it, and you can download it as a PDF on the back end so if you're looking for something like that a little bit more engagement.

[Cara North] 12:05:50
You know you can possibly loot use this tool. All right. Sushi says let's go someone to roll with with someone with an alien emoji okay alright so let's go with the first question here.

[Cara North] 12:06:03
It is going to be time just for, you know, just for this particular sector so David Lafayette has the title of being cool dad in the bag. He's known for his viral artwork on.

[Cara North] 12:06:16
Now your choices are school buses Jim's sandwich bags, or cars, David Lafayette I mean hopefully you all know all about him right. So, Give it a few more moments here.

[Cara North] 12:06:31
David Lafayette and his, his viral artwork.

[Cara North] 12:06:35
All right, let's take a look here last three seconds.

[Cara North] 12:06:39
Okay, let's take a look.

[Cara North] 12:06:41
Oh, look at that. The majority of you all were able to get that corrected from sandwich bags. Interesting. Okay.

[Cara North] 12:06:48
All right.

[Cara North] 12:06:51
All right, here's the next question.

[Cara North] 12:06:55
So to pull a prank on a fellow ornithologist john autobahn.

[Cara North] 12:07:01
Did he stole his horse created fake species for a rival to still in publish his research forged diary notes or disappeared for two years now. I don't know if I have any video game fans in the house but I am convinced that before Grand Theft Auto there

[Cara North] 12:07:19
had to be grand theft horse, right, I don't know if they made that a game yet but maybe it's a prequel coming, hopefully, okay. Alright so let's look at the answers.

[Cara North] 12:07:27
Look at that. Okay, so most of you all got that one correct as well. So again, smart Smart Cookies.

[Cara North] 12:07:35
All right, two more questions. This one is probably one of my favorites. So in the 1930s Sir Winston Churchill received a prescription from a doctor advising, is it unlimited amounts of alcohol.

[Cara North] 12:07:48
If he stopped washing his hands. Totally gross sleep for eight hours a night or exercising Winston Churchill wonder what he got a prescription of Elizabeth I love that yeah I guess they did do that with in Red Dead Didn't they were you could still a horse

[Cara North] 12:08:03
and stuff to share I like it.

[Cara North] 12:08:07
All right, few more moments here about Sir Winston Churchill.

[Cara North] 12:08:12
Right.

[Cara North] 12:08:14
So look at the answers. Okay so this one tripped some of you up but good news is we're on talk about it here in just a moment. It is an app, it's an unlimited amount of alcohol.

[Cara North] 12:08:24
Who wants a doctor like that.

[Cara North] 12:08:26
Maybe. Okay. All right. And last question. Last but not least, is, uh, what was the occupation of john autobahn goodness I feel like I've heard that before but maybe it's just something in my mind was john Audubon a doctor ornithologist biologist, or

[Cara North] 12:08:44
scientist, john autobahn. I feel like I've heard it before but I could be completely wrong. There's been a lot of stuff thrown at me the last couple days so I don't remember if it was like someone I met here at the conference, or I don't know so sounds

[Cara North] 12:08:58
familiar john autobahn. All right. Let's take a look.

[Cara North] 12:09:03
Look at that. ornithologist so you all got the majority of that right now let's see who gets the bragging rights of this, see who won.

[Cara North] 12:09:16
Congrats staff, the job so proud of you and I'm assuming that's a koala which is super cute. So, great, great job. Now, question. I know you all didn't know that content, because you know where I got that content from Ripley's Believe it or not.

[Cara North] 12:09:33
So, this, the content right here that part that's actually a game that I developed a few years ago. And so if you go over to the marrow board on my section, I put a little sticky note there with a link where you can play the game.

[Cara North] 12:09:45
And so it goes through multiple different ways that you can make errors, writing something like a multiple choice, where people can guess the correct answer.

[Cara North] 12:09:55
It's a micro loans about five to seven minutes, and it's something that is free, open for everybody. It was created and funded with US Department of Education money which means it's public facing so feel free to share that with your teams and go through

[Cara North] 12:10:10
it and bonus I'll give you a little secret to make it all the way to the end. There's a button at the very end that says more information. If you click on it, it will link out to each one of the facts, so you can learn more about Winston Churchill's weird

[Cara North] 12:10:26
prescription and the you can actually see pictures of the sandwich bags, the guy draw so it's a nice little easter egg I put in there just for people that made it to the very end.

[Cara North] 12:10:36
Alright, so I want to go through the four questions that I picked out again if you play the full game I don't don't unfortunately don't have time to go through everything in 30 minutes, but I picked out for primary ones that I see a lot of multiple choice

[Cara North] 12:10:52
questions mess up okay so this one is something called a Jeopardy clue so Jeopardy being a quiz game popular in the United States. I'm actually pretty decent at jeopardy.

[Cara North] 12:11:02
It's not because I'm smart, but it's because when Jeopardy rights questions they leave context clues in the question to help guide you to what the answer is.

[Cara North] 12:11:12
OK, so in this particular question, you can see the word bag. Okay, so that is a cue that the potential correct answer is likely a sandwich bag. So if you know nothing about it, you are just like, oh cool dad in the bag old acts upon.

[Cara North] 12:11:27
Oh that's upon. That's a clue. It's likely going to be a sandwich bag so people will select sandwich bag and it'll be the correct answer, whether they actually knew the content, or not.

[Cara North] 12:11:36
Okay, this one is just a hot mess, but this one has really bad syntax. Okay, So if you're reading the sentence usually when you write a question like this, as people are going through it, they're going to try to fill in the blank.

[Cara North] 12:11:48
Okay, so they're going through, and the only one that actually logically makes sense in, I would say English could be an unlimited amount of alcohol. Now here's a bonus, special one here, it's only one of the actual punctuation to so that was looking

[Cara North] 12:12:18
little hint there and but actually if you go if you're curious about the, the fact it was he I think he visited the United States during the prohibition era and I think that's why he got the, the prescription for the unlimited amount of alcohol if you

[Cara North] 12:12:21
if you're curious because it is kind of a weird word fact.

[Cara North] 12:12:23
All right. This one is pretty classic. When you were in primary school you probably got advice that the longest answer choice is the correct one. And so what happens when people develop questions like this.

[Cara North] 12:12:38
Often they work with a subject matter expert, and they focus so much on making sure it's the absolute correct answer that you pack so much content into it, they have this big long choice, and then you struggle to make choices that are in a similar length.

[Cara North] 12:12:54
Okay. So for this one you could actually fix it very easily if you drop everything after animals in the long one, it actually makes it a little bit more balanced and will make it a little bit more challenging for people to guess the correct answer so

[Cara North] 12:13:08
whenever you are using multiple choice. I like to think of it as like a balancing act algebra you want it to be balanced on multiple sides. Okay.

[Cara North] 12:13:18
Sorry I'm also trying to watch the chat too so if I miss something just just yell at me.

[Cara North] 12:13:23
And then this one I don't know again sorry Australians, I don't know if you all know when Stephanie is or not but if not, she's a American song singer.

[Cara North] 12:13:33
She used to be in a band called no doubt that was one of my favorite bands. My very first CD was a no doubt see tragic kingdom. So she has a song called hollow back girl when she decided to okay just making sure I you know i i don't assume anything okay

[Cara North] 12:13:48
so with the holler back girl, that's when you have a call back to the correct answer and another question. Okay, so if you remember the question about, you know, pulling a prank on a fellow ornithologist john autobahn did it up.

[Cara North] 12:14:04
So if you're a smart test taker you go back and you would look at that and you could infer oh yeah john Audubon fellow ornithologist he's appear. So that means that that would be the correct answer and he would be an ornithologist, so make sure when you

[Cara North] 12:14:19
are writing assessments like that if you're using multiple choice, again, that it stands alone, that it's able to not give any additional contacts to potentially answer a question, further down the road.

[Cara North] 12:14:33
Okay, so that's all I want to talk about multiple choice, I had to talk a little bit about it again go to the marrow board, I put the link in there that you all can play the game free open to everybody and takes like five to seven minutes to play it.

[Cara North] 12:14:47
All right.

[Cara North] 12:14:50
So, I'm just again to revisit some of the issues so here's if we were just on classify for I think of the biggest mistakes and writing, multiple choice, these will be the for that I would pick so again making sure that there's no context clues.

[Cara North] 12:15:05
There's no like callback to anything to where everything is standing alone that everybody can follow along the longest answer is the right answer. And then I switched it up arrow Levine, the only whoever Levine is she's also an American singer had a song

[Cara North] 12:15:21
called complicated so why you got to make it so complicated. So, with the complicated meaning that syntax you remember how messy that one was so I call that one that absolutely Why did I make it so so complicated.

[Cara North] 12:15:34
Yeah, David, I completely agree with, do not use all of the above or none of the above. And the reason that that is the case is, I believe when you're writing a multiple choice question, there's kind of unwritten rule that there's only one correct answer.

[Cara North] 12:15:51
I really don't like the ones that have like the, you know, they have the select all and all that stuff I think that's really difficult for people and so usually what will happen with an all or none of the above.

[Cara North] 12:16:05
People will overwhelmingly always select that regardless of the content so that's kind of Pitbull number one. People number two is if you have at the end, and somebody very quickly going through it and they're reading it, and they see a correct answer

[Cara North] 12:16:16
on the top. A lot of times people that miss those will circle that first one and just move on and keep on selling through. So it's really kind of a pitfall.

[Cara North] 12:16:26
I think it's really important to make sure there's only one correct answer in a multiple choice, that doesn't need to be more complex than it is.

[Cara North] 12:16:33
Alright, so, Jenny did an amazing job earlier talking about scenarios and so I want to talk about some common mistakes and scenario writing. Okay. And so here are the four that we're going to spend some time with today.

[Cara North] 12:16:46
And so, the one the first ones want to be a reality show, and I'll kind of let that one similar Have you think about what that is.

[Cara North] 12:16:55
The scenario not being needed or what I call too much information or TMI only having one question associated with it so you write this big amazing scenario but you only have one question to go with it.

[Cara North] 12:17:07
And then when you don't have enough information to answer the question right you're still looking through the scenario and yours, like, I don't have a clue like I don't have enough information to make a determination of this Okay, so I hope you don't

[Cara North] 12:17:19
mind I've written some really bad questions again and we're going to talk about it and revise them in real time. Okay, so let's say hypothetically. This to me is a great reality show scenario and by reality show, I mean it's complex, there's all these

[Cara North] 12:17:34
characters you gotta, you gotta keep track of everything. And so if we're, we will read this kind of together.

[Cara North] 12:17:41
Carolyn as a shift manager at a daycare facility. She's in charge of scheduling the team out is the parent of a child who attends to daycare. He can't pick up his daughter Alyssa on time.

[Cara North] 12:18:00
help them out and bring Alyssa to his cousin Rick's house.

[Cara North] 12:18:03
I'm confused even just reading it out loud, but that's not even the the big problem here. The big problem here is the actual question, look at the question here.

[Cara North] 12:18:12
According to COPPA, which is a legal standard around child care in the United States. What will Carolyn. Tell me any guesses let me know in the chat. What is wrong with that question.

[Cara North] 12:18:25
Like, what's your kind of your knee, knee jerk reaction again, given all the great content we've had up to this point, talking about assessment what what are maybe some issues with with that particular question.

[Cara North] 12:18:34
according to Copa, what will Carolyn tell owl.

[Cara North] 12:18:39
Well yeah, that's a great one Jimmy what is Copa right and Copa should have been mentioned in this scenario. Absolutely.

[Cara North] 12:18:48
All right, yes. Yeah, Karen. Somebody just hit it right there. Yeah, I've already forgotten who Carolyn and LR right Ricky.

[Cara North] 12:18:56
Yeah, I mean it's it's just a cluster right, you easily wasted somebody's precious time reading this and you still don't have any clarity on what it is that's going on, so I will tell you my biggest problem with this question.

[Cara North] 12:19:11
Carolyn. Okay. Does Carolyn follow the rules, she got employee, she little naughty, you know it's clearly not doing what she's supposed to be doing. I don't know, I don't know.

[Cara North] 12:19:22
And furthermore, my bigger issue with it, is where am I in this scenario, right, so we've talked about the power of perspective, and other sessions today.

[Cara North] 12:19:32
I think it's so critical to anchor your learner in the scenario, put them in it. Right. Put some skin in the game for it. Okay, so how we would switch this and make it a little bit better, is something like this.

[Cara North] 12:19:47
So we're all cleaning up we took out a bunch of the names right. So it starts out, you are a shift manager at a daycare facility. Okay, so you. So it's very clear, who you are, what you're doing all that stuff.

[Cara North] 12:20:06
You know you're in charge of scheduling for the team that did it. Now here's the kicker.

[Cara North] 12:20:12
According to COPPA what information should you provide different question, right, so we're not asking about the perspective of Carolyn if you say, but we're actually saying okay.

[Cara North] 12:20:25
What are you doing, what should you do in this particular situation, little bit stronger little bit better. So, my big advice, writing scenarios anchor your person in it.

[Cara North] 12:20:35
I love the example Jenny shared earlier of the video with the the you know the first person perspective of, you know, you're talking to the person there it was.

[Cara North] 12:20:45
It was wonderful. So, I think something like this could really translate well into an example like that.

[Cara North] 12:20:52
All right, here's this one okay so this is a OE where you want to know the correct answer. I believe that you can't provide me the information if I recall correctly, because it's, it's protected data you can't give out names and phone numbers of other

[Cara North] 12:21:09
people that have children at the at the place I believe so. But it's been a hot minute so thanks for asking.

[Cara North] 12:21:16
Okay, so this one is what I call the too much information error so you like reading this here.

[Cara North] 12:21:23
You're laying flooring for a square room measuring 10 feet on each side and you're using floor tiles, the blood are sold at 15 square yard, but then look at the question here.

[Cara North] 12:21:33
How many square feet are in one yard.

[Cara North] 12:21:37
That's just simple math. That has nothing to do with anything about the dimension of that room, how much it costs, etc. And so, so often is that we need to make sure that the information provided needs to be there.

[Cara North] 12:21:55
So, it doesn't need to be adding context in you know and so often you get that oh let's just give them some context, right, that confused somebody and confuse them on a very simple question about how many square feet are in the yard right so in order

[Cara North] 12:22:11
to fix this, just get that junk out of they're thrown away, push it out and just ask, just ask a question like this. Okay, so this is how you would revise something like that now if it was really critical to test somebody on that or assess it, feel free

[Cara North] 12:22:25
to pop it into something else, but don't give it just to give context to think, oh I want to make it more cool, or hip or give it that that historical research know, just ask the question.

[Cara North] 12:22:36
Okay.

[Cara North] 12:22:40
Alright, so here's another one. Let's say that you have this scenario here about owning a camel farm and things like that and then if a power source is six volt what is the current.

[Cara North] 12:22:41
Um.

[Cara North] 12:22:53
So, not not bad, but here's the problem. Again, it takes time for people to read scenarios, it takes time for them to go through it. So a good practice is after you've written a good scenario, try to ask at least two to three questions out of it, right,

[Cara North] 12:23:08
that way again you're taking the time you're respecting someone's time rather of the reading and you're able to pull out more so this probably isn't good enough for three questions, but if you added some more information here, you could potentially have

[Cara North] 12:23:24
questions, like this. So feel free.

[Cara North] 12:23:30
I don't know if a camel is two arms. That's pretty funny. I'm sorry I'm kind of distracted Ralph you're naughty. Um, but yeah so here are the three three questions that you could potentially put put together on it.

[Cara North] 12:23:43
Alright, so we talked a little bit of a multiple choice talk a little bit about scenarios. Let's talk about making them measurable now this is going to be extremely controversial.

[Cara North] 12:23:53
And I'm going to say it and hopefully you won't get angry.

[Cara North] 12:23:57
But I think it all starts going back to basics with a good needs assessment. Too often we get requests and asks for training that has nothing to do with training, and it's literally something about somebody needs to know something or we need to communicate,

[Cara North] 12:24:15
or whatever, and really good means assessment is really helping to justify validate or debunk as I like to say that training request and not everything is training right.

[Cara North] 12:24:29
One of my favorite quotes of all time one of my knowledge crushes Dr Michael Allen said it, that if content was enough, we'd only have libraries and not schools, and so often they just want us to keep their own content at people, and then they wonder

[Cara North] 12:24:41
why they can't do anything or they wonder why they hate the experience or they wonder why there's this negative reaction right. So to really do good assessment.

[Cara North] 12:24:50
It starts with a good needs assessment period, that's just, I know that's a little controversial but I think it's really important.

[Cara North] 12:24:58
And so, you know, I really liked this work by gentleman who's a human performance person and he talks about you know how can you focus on, you know, the aspects that we can control and l&d, and these are great ways to have a good baseline for an assessment,

[Cara North] 12:25:16
making sure that whatever the content is or questions appropriate to the task or process, appropriate to the person, and it contains just enough information to get them there or to get them in a way that they can practice which I think is really really

[Cara North] 12:25:32
incredible also huge fan of Kathy more and so at the end Kathy more does a great job of again, setting you up for success with assessments along the way, because if you can set a goal or key performance indicator, and the front end and you can back it

[Cara North] 12:25:50
and align your assessments to it, it's going to be so strong, and some of the questions here about you know what is the problem. How's it going to be solved.

[Cara North] 12:25:59
You know why do people need to do why they're not doing it. Treasure Trove for assessment questions, but my favorite thing to use to build assessment questions is again something has been around a long time but I don't see it get enough love is a task

[Cara North] 12:26:15
analysis. Okay. So this is an example of a task analysis actually used my partner I said hey, I want to make a fake task analysis he drives a semi truck, and he talks about yesterday a pre trip before he drives.

[Cara North] 12:26:30
And so basically what a task analysis is is going through step by step, what it is that somebody has to do, but you're collecting extra information and the couple columns I really want to highlight here performance measure how do they know they're doing

[Cara North] 12:26:44
it right. Okay, great, great source for assessment.

[Cara North] 12:26:48
But these two right over here, are phenomenal. This is almost like those subliminal questions you're asking yourself along the way, like, Did I do that.

[Cara North] 12:26:58
Did I do that, capturing that's a treasure trove for your assessment, as well as the errors, how do people screw it up. People love talking about that by the way if you ask them they have stories upon stories about that so capturing that figuring out

[Cara North] 12:27:12
how to assess, or at content or clarity around that, to me that's what good training is right, it gives people a chance to practice and gives people a chance to apply the content, and a good trainings a good place to fail to, we want them to experiment,

[Cara North] 12:27:29
we want them to try things out and training, right, because it's going to prepare them for all those what ifs or weird things that happen happen on the job.

[Cara North] 12:27:40
All right. So two things I like to, for you to just take away and again, thank you so much for just the time today really appreciate it.

[Cara North] 12:27:49
I am giving you a couple challenges so one is you know in your assessments that you currently have, is just like a multiple choice scenario, whatever, go back into the data mining.

[Cara North] 12:28:01
And if you see that it's missed by more than 50% of people. There's a problem. It's either a problem with the assessment, or it could be a problem with the content, or maybe both.

[Cara North] 12:28:12
And then the second is you know really think about what a needs assessment process could look like at your org If you don't currently have one.

[Cara North] 12:28:19
I think it's a superpower I think it's one of the best things that we can do. And one of the best value adds that we give back to our organizations. I think so often it's skipped.

[Cara North] 12:28:30
So, With that, if you'd like to connect with me here are the ways. Oh gosh, I got really excited there click the wrong button you'll.

[Cara North] 12:28:38
Okay. Um, so, LinkedIn, Twitter, there are my website, caranorth.net or the Learning Camel consulting, my email, and then shameless plug I have a book coming out next spring learning experience design essential to add press.

[Cara North] 12:28:52
So if you like content like this I dive in a little bit deeper and I have a couple of moments for questions and answers but thank you all so much for just being a part of this amazing assessment summit, and I hope that you get a lot, a lot of good goodies

[Cara North] 12:29:05
from today.

[Cara North] 12:29:18
Okay, question when you use that task analysis and performance analysis approach what types of assessment strategies have you ended up with oh gosh lots.

[Cara North] 12:29:40
steps like having somebody monitor audit, etc. It's been great for performance support training on the back end right so really making sure that people are reinforcing the content because too often people go through learning experience and they don't

[Cara North] 12:29:53
actually get to use the content for a little bit. So, you know, being able to assess them kind of see where they're at, I call it like a litmus test right to see kind of see where they're at and then being able to to build upon it is really critical but

[Cara North] 12:30:07
then also to for competency based so if somebody already knows it. Don't waste their time, if they're able to perform at the level that you're asking.

[Cara North] 12:30:20
Don't waste their time, let them do what they do best for their organizations and that's usually not taking training people aren't paid to take training they're there to work and do other things so

[Cara North] 12:30:29
love lovely answer. Thank you for really great session to deep dive into a few things and lovely way of thinking about some of those problems with multiple choice questions and how to build really great scenarios.

[Robin Petterd - Host] 12:30:41
So thank you. For taking the time out of your already busy day to do this. 

[Robin Petterd - Host] 12:30:48
Talk and getting it all over - all over and done with in one day so thank you so much Cara.

[Cara North] 12:30:53
Thank you.

Jinjing Zhao - Connecting Course Assessments to Program Outcomes

Bikram Kawan - xAPI and Assessment