If you're looking to understand evaluation metrics, you won't want to miss this podcast episode! We emphasize the importance of selecting relevant and actionable metrics, encourage the use of open-ended questions to capture a complete picture, and remind evaluators to consider societal norms and strive for equity and inclusivity. Learn how to effectively evaluate and improve your processes with our expert advice on evaluation metrics. Tune in now to "The Art of Asking: Effective Evaluation Metrics | What They Really Mean and How to Use Them."
If you're looking to understand evaluation metrics, you won't want to miss this podcast episode! We emphasize the importance of selecting relevant and actionable metrics, encourage the use of open-ended questions to capture a complete picture, and remind evaluators to consider societal norms and strive for equity and inclusivity. Learn how to effectively evaluate and improve your processes with our expert advice on evaluation metrics. Tune in now to "The Art of Asking: Effective Evaluation Metrics | What They Really Mean and How to Use Them."
we are live
0:08
[Music]
0:11
welcome to two minds today with your
0:13
host Charlene Authority and leadership
0:15
development and Hala an expert Community
0:17
Builder the Pod all about best practices
0:20
to get you noticed and ahead in your
0:22
professional life
0:24
hello hello hello how are you doing
0:28
Charlene I'm good
0:30
I'm good doing oh it's been a long it's
0:33
been uh two weeks this time usually
0:34
we're at the week yeah we miss our group
0:38
we I we we did miss our group
0:42
um how are you doing what's happening
0:44
with you
0:45
I am good thank you I had a lot of time
0:49
to think about our topic that's coming
0:51
up this week ah yes I feel like it is
0:55
such a good topic we are talking about
0:58
I'll throw it up on the screen for those
1:00
watching live is the art of asking we're
1:04
talking about effective evaluation
1:05
metrics what they mean how to use them
1:08
and I feel like this is really apropos
1:10
because I I think everyone is on a
1:12
different work schedule but I know in
1:14
springtime a lot of people are coming up
1:15
with
1:17
um uh different evaluation and program
1:20
ends and even maybe your personal work
1:23
evaluation is coming up so we thought we
1:26
would dive in today on really
1:29
um we all do a lot of evaluations but
1:31
what does that really mean and when
1:32
should we be doing them which I think
1:34
leads us to our first question
1:36
that's right so our first question
1:38
really is how do we do this evaluation
1:41
it's choosing meaningful metrics right
1:44
what kind of evaluation do we do and how
1:47
do we set about it if you're developing
1:50
it or
1:51
what do you do
1:53
what are your thoughts
1:55
yeah
1:57
so choosing meaningful metrics I really
2:02
Scrolls scroll back in my mind to what
2:05
are you when do you actually want to
2:07
know
2:08
um and I think that you need to ask
2:11
questions based on the answers you
2:13
actually want to know
2:14
um and I would even add to say don't ask
2:17
questions that you're not going to do
2:18
anything about right like we how many
2:21
times do we ask for things on feedback
2:23
and then we're like yeah we know that
2:25
the room was cold but there's nothing we
2:26
could do about it right or whatever my
2:28
new show is coming I absolutely love
2:30
that I also would put in that category
2:32
asking questions where you already know
2:35
the answers to right if you don't if you
2:38
don't need to know like where are you
2:40
working because this evaluation is
2:42
exactly that same company please don't
2:44
ask don't ask if it's in the U.S if your
2:46
company is in the U.S because all of
2:49
that makes it less likely for people to
2:51
fill out an evaluation because you're
2:53
taking up valuable time get right to the
2:55
point of what you want if you want if
2:57
you don't really need people's names and
3:00
you want it to be anonymous don't put it
3:02
up front make it be the very last thing
3:04
after people have already vested their
3:06
time in it so go right right into asking
3:09
your questions and forget about all that
3:11
extra that
3:13
makes you feel like you're wasting your
3:15
time as you're filling out that
3:16
evaluation I often um just as you said
3:19
as the last one to be like if you would
3:21
like someone to get back to you provide
3:23
your name and email here and
3:26
um otherwise I don't and I so I feel
3:28
like twofold on that one I absolutely
3:31
never ever ever think a survey I'm
3:33
taking is anonymous I don't care who has
3:35
convinced me it's Anonymous I don't
3:37
believe it for a second I just feel like
3:40
there's too much technology out there
3:42
and I I've had data people like this
3:44
one's really Anonymous I'm like okay
3:45
it's probably not or maybe it kind of is
3:48
um but the more information you put into
3:50
the survey it is probably not a loss
3:52
none of us so I'm just I'm saying that
3:54
right
3:56
um and that's a really good point
3:58
actually with respect to the more
3:59
information because people can always
4:01
just like you know Whittle it down and
4:03
figure out oh you work in this
4:05
department you're a female in this
4:06
department well there's only two females
4:08
and we know the one who never fills it
4:10
out so boom right so you have to be yeah
4:13
which makes it by the way more weary of
4:16
people to fill out the evaluation so
4:18
think about it if you actually want to
4:20
get information don't over ask
4:23
yes and yes ask what's relevant ask
4:26
what's meaningful ask what's going to
4:28
get you the answers you're looking for
4:30
are you looking to improve are you
4:32
looking for just validation that you did
4:34
something right or wrong
4:37
um just really think about it and and I
4:39
just did a Survey Monkey survey and
4:41
what's cool about that is it will give
4:43
you your estimated time for how long it
4:45
will take to fill um fill it out I think
4:48
that's really good for a user end
4:49
whereas like this was a three-minute
4:51
survey this is how long it'll take you
4:52
to fill out I think that's super helpful
4:56
I agree with you 100 and keeping is what
4:59
I was saying before don't make it too
5:01
long right the minute I see a survey
5:03
that's like 10 minutes forget it I don't
5:04
have 10 minutes to give anybody and it
5:06
sounds like 10 minutes isn't such a long
5:08
time but in our fast-paced world where
5:11
you have your phone in your hand and
5:12
you've got a lot of other distractions
5:14
going on if you want something make it
5:16
quick make it fast you know right off
5:19
the bat I also recommend people that if
5:21
you're doing a survey if at all possible
5:24
check in there where you can respond
5:26
right away by the click in the body
5:30
don't have it like redirect to somewhere
5:32
else where you then yeah
5:34
ask your one or two questions right off
5:37
the bat at the bottom of that email text
5:40
whatever form of communication that
5:42
you're using I love that if you can do
5:43
it okay so let's go on to our next thing
5:46
to ask open-ended questions all right so
5:50
tell me about this a lot what do you
5:51
mean by what do we mean by ask
5:53
open-ended questions yeah so it's a good
5:55
you know when you fill out surveys what
5:57
do you prefer Charlene do you prefer the
5:59
multiple choice I am the people that
6:01
hate filling out these surveys because I
6:03
don't believe that they're Anonymous I I
6:05
also and and and I may Loop to this a
6:09
different time but I am so open and
6:11
transparent anybody can ask me anything
6:14
and I will give you direct and honest
6:15
feedback but in these evaluations I'm
6:18
like everything's awesome which we'll
6:20
we'll get to in a little bit oh that's
6:22
so interesting so you would rather have
6:23
since you think that it's all like you
6:25
know canned and all being watched by Big
6:28
Brother you just want to like click your
6:31
ABCD be done with it or your scale of
6:33
one to ten you don't like the open-ended
6:36
questions that requires you to like I
6:38
write what you actually think in your
6:40
mind so what's interesting today is
6:42
we're looking at it sort of um
6:44
simultaneously from both points of view
6:46
right from the survey filler outer to
6:49
the survey asker right as someone who
6:52
creates surveys and facilitates them for
6:55
people to answer I really like almost
6:57
skip the numbers and go right to the
6:59
open-ended questions because I feel like
7:02
that is where I'm getting
7:04
um the most information right if you ask
7:08
the question
7:10
um whatever did you like session a and
7:12
it's a one to five scale they give it a
7:14
three or two or one or a five I have no
7:17
idea did you give it a five because you
7:19
were in a good mood that day and it
7:20
resonated did you give it a one because
7:22
you were
7:24
um because the speaker was ah like was
7:27
having a bad day did you give it a three
7:29
because you just weren't there and
7:31
actually had weren't paying attention
7:32
and you were getting your coffee and
7:34
going to the bathroom when when it came
7:36
in so I find like one through fives
7:40
um less useful as information
7:43
um one thing that was was really
7:45
interesting is it was a one through five
7:47
rating and then after that the follow-up
7:48
question is like why did you give it a
7:50
one through five and I'm like oh that's
7:51
helpful right yeah so that is helpful
7:54
but that just takes up more time right
7:57
so you have to be very very thoughtful
8:00
when you're creating the survey what is
8:02
it exactly that you want to get at and I
8:05
do understand the sense of we're taking
8:06
up people's time and we have them we
8:08
have a captured audience let's get as
8:10
much information out of them as we can
8:12
but what you risk when you push that
8:15
envelope of getting as much information
8:16
as possible is falling in that category
8:19
of getting no useful information
8:21
whatsoever because I just I'm gonna fill
8:23
out anything I possibly can to get to
8:26
the next step which is claim my ten
8:28
dollar check or be finished with this
8:30
because then I'm going to get my credit
8:32
for this course that I took so you're
8:34
not going to pay attention and really
8:36
fill it out honestly when I'm creating
8:38
in a vacuum I think the three best
8:40
questions you can ask are what did I
8:42
learn it's a quick check on did you
8:44
actually learn anything what did I value
8:46
why was it interesting to somebody and
8:49
that's real specific but it's very
8:50
helpful if you can collect the data and
8:52
three what would I change because
8:54
otherwise people will be like nothing
8:56
and sometimes you still get nothing but
8:58
sometimes you get really great feedback
9:00
and like
9:01
um because someone
9:03
when you're giving feedback your thing
9:05
is done and it's over right so you're
9:07
like it's over what would I change I
9:09
don't know I would have eaten more
9:11
before I went to class but like when you
9:13
think that the session is being run
9:15
again for the future of like Hey we're
9:16
running this again what would you
9:18
suggest we change for the next group of
9:20
people you get really good responses in
9:22
my opinion and what I like about those
9:24
three questions is that it's not really
9:26
wasting someone's time you're like yeah
9:29
you're authentically asking someone
9:31
about their experience and I think
9:33
that's where people are tired people are
9:35
are tired of giving information that
9:37
goes nowhere people are tired of having
9:39
their time spent filling out data points
9:43
and yep being a part of that whole data
9:45
machine but um let's go on to our next
9:48
things we're talking about that data
9:49
machine because we want to give you a
9:52
little bit of insight about how that
9:53
data machine really works behind the
9:55
scenes when you are filling out the
9:58
quantitative type of surveys that are
10:01
asking you to fill out one to ten or one
10:03
to five yeah so I recently saw Tick Tock
10:06
that reminded me of something I already
10:08
knew which is always because I was like
10:09
oh yeah I totally forgot about that so
10:12
it was a someone talking about service
10:15
calls you know when you call your cable
10:16
company and they're like we have a
10:18
survey following this can you mind
10:19
filling it out blah blah and The Tick
10:22
Tock was like this is a reminder you are
10:24
not actually evaluating how awful the
10:27
call was that the cable person was not
10:29
able to help you in any way shape or
10:31
form you are actually serving if they
10:34
get to keep their job or not and by the
10:37
way tense like when it's one through ten
10:39
ten only because nine is fe8 they're
10:41
already you're already on the negative
10:43
downswing and people are literally
10:46
evaluated so this color that was not
10:48
able to help you in any way shape or
10:49
form because of the way their company is
10:51
set up and they're not actually just
10:52
able to help you you're like oh that was
10:55
annoying they were fine but I'm giving
10:57
them a seven that's actually already
10:58
down on the negative and we think like
11:00
seven that's great it is not great tens
11:02
only um if you don't want to hurt the
11:05
other person I mean that's an effect and
11:07
it's so interesting right we just came
11:09
off of asking an open-ended questions
11:11
and the importance of getting real data
11:13
and what we're saying now is if it's
11:15
numerical based forget about the real
11:17
data because everything is skewed it's
11:20
not what you once used to think if you
11:22
think you have a one to ten scale you
11:24
really have to give a 10 no matter what
11:26
because there's some real life impact
11:28
that happens since people aren't really
11:30
sitting there parsing out these surveys
11:32
and filling it out in a nuanced way most
11:34
people are saying ten five zero they're
11:37
not cutting it out they're not splicing
11:39
it so the data that comes out on the
11:42
other end has real impact
11:46
I would say you can fill out and you can
11:48
put whatever you want I will just let
11:50
you know that I think it's tens of nines
11:53
are you're fine sevens and eights are
11:55
neutral under seven is is a negative so
11:58
I think it's fine just when you are
12:00
filling it also like that's important to
12:02
read Because You're Gonna your next your
12:04
if you are not um in a situation where
12:07
your boss or your supervisor like in
12:10
this call center who are actually being
12:12
evaluated by these numbers and you can
12:14
emotionally take a Beat from this and
12:16
recalibrate yourself that's fantastic
12:18
then you can look at the numbers well
12:20
but what I would say then though as an
12:23
employer who's giving out these surveys
12:25
or an employee who's giving it out to
12:27
their customers whatever it is please
12:30
take that moment to educate the people
12:32
filling out the survey and let them know
12:34
exactly that that if you're satisfied
12:37
you give a 10. we understand it's a one
12:39
to ten scale but honestly there's really
12:40
three numbers that matter ten I keep my
12:43
job bad
12:45
seven I don't whatever the real life
12:47
modification is and that's it and you
12:49
tell and I want you to be honest and I
12:51
want you to fill it out but we want you
12:52
to understand what these numbers really
12:54
mean and it's okay I believe to say that
12:57
to people that are filling it out
12:58
because people don't always know what it
13:01
is and they have their own preconceived
13:02
notions so I think uh we are coming up
13:06
to the end of this podcast tell me
13:08
Charlene what's your takeaway today all
13:11
right so one you're going to ask
13:13
questions that you actually want answers
13:15
to choose meaningful metrics two we're
13:18
asking open-ended questions I will also
13:20
say that um for open-ended questions
13:22
always make them optional so that you
13:24
don't lose people but you can still get
13:26
the feedback and keep in the back of
13:28
your mind if someone's taking the time
13:29
to write they probably really liked it
13:31
and really or really didn't and you kind
13:34
of are missing out on the middle Zone
13:35
but that's okay just know that when
13:37
you're reading it and three are awkward
13:40
societal Norms now where sevens are bad
13:42
just know it and own it
13:44
absolutely I love that summary and next
13:47
week come back and stay tuned because
13:50
we're going to talk about how to deal
13:51
with this feedback that we get yep all
13:55
right thank you all for joining and we
13:57
will see you next time let's see I was
14:00
gonna do a little outro music for us
14:02
today let's see if I can find some outro
14:04
music let's do that
14:06
and in the meantime everyone remember to
14:09
learn a little more every day the uh
14:14
foreign
English (auto-generated)