Sandbox

You can use this Sandbox to try out things with the Amara tool.

The video that is primarily streaming here is http://www.youtube.com/watch?v=ZU2kyr9jRkg , which is completely blank. But you can go to the URLs tab to add the URL of another video and make it primary.

Please remember to download your subtitles if you want to keep them, as they will get deleted - and the streaming URL reverted to the blank video if you changed it - after a week or two,

you want to make your Bott writing

experience much more enjoyable you're

not gonna want to miss this episode of

the AI show where Tony takes us through

the new bot framework emulator new and

improved shiny amazing you're not gonna

want to miss it

take a look

[Music]

hello and welcome to this episode of the

AI show we're going to talk about the

new quad emulator doing it right that is

right how you doing Tony I'm doing well

how are you doing good tell us what you

are and what you do so yeah my name is

Tony and Zion oh and I am one of the

developers on the Microsoft bot

framework and Azure about service team

and over the past few months I've been

working a lot on the new bot for America

emulator and I'm pretty excited to show

you guys some of the new features we

have alright let's take a look okay and

for any of those who don't know the bot

framework emulator or the you know

Microsoft off framework check us out on

our website at Deb ball framework comm

also on Azure under products in AI and

machine learning and then we also have

some get started getting started

resources and Doc's on Doc's table

Microsoft comm fantastic so you got all

the deets now let's take a look at all

the bits ok so here's kind of this

end-to-end development workflow we have

that's around developing a bot from

start to finish and we've centered this

around this new suite of tools we have

called bot builder tools nice

appropriate lead of course okay and so

the emulator doesn't cover all these

areas but what it does cover is planning

testing and refining your BOTS and it

excels at those pretty well so yeah

because like once you start building

BOTS the first one you build you're like

oh now I get this I ever actually

planned this like I do all my software

which takes a bit of time yeah and these

tools are designed to help with that

correct all right let's say ok so yeah

so we have this new transcript mode and

presentation mode and transcripts which

help you basically view mocked

conversations as they would look in

production without having to write a

single line of code so that's pretty

cool for testing you know we have all

the core functionalities of the old bot

emulator which basically allows you to

set debug set breakpoints in your code

and have a full debugging experience and

refining your bot we have this really

cool piece of UI called the inspector

panel which allows you to look at all

the underlying structure of your

messages to and from your bot and your

network traffic and all that stuff so

you can actually get in there and debug

yeah you can see what's going on behind

the scenes everything ok so now that

I've talked about all this let me kind

of dive in and show you what I'm talking

about here's to it so here we are in the

new emulator welcome page you can see

we've given it a pretty significant face

for any of those who have used the old

one and so basically what I'm gonna do

is show you transcripts and what those

are because they're a brand new concept

so let's go ahead and open this

transcript in the left over here and now

what you'll see is it has populated this

web chat window with basically every

every conversation or every message in

this conversations history just like we

had this conversation right here this is

literally like wire framing your old old

apps that we used to have Windows with

right right this is like wire framing a

chapter right exactly so what a

transcript is it's basically just a

record of a conversation you had with a

bot that the emulator can understand is

it what kind of format are we talking

about

no it's basically just a JSON array of

just a bunch of conversation activities

so you can literally type one up and

notepad um still I'll get to that later

that will be with chat down and that

converts to a transcript but transcripts

are actually Auto generated by the

emulator so I'll show you how to do that

fantastic so basically let's open up a

live chat so this means I'm talking with

a remote bot right here we can see it's

talking to test spot bot framework comm

so test bot is just gonna you know F go

back whatever I say hey test bot will

say hey you know I can give it a smiley

face echo stuff like that

and basically getting a transcript file

from this is as easy as going up here

hitting save transcript as and then you

just say you know just made this and we

can save it we can see it populated in

this File Explorer window to the left

and we can click that and open it and

boom there's the conversation we just

had with test box cool so and then one

other way to do it is with our new tool

called chat down so real quick I'll show

you how easy it is to create a

transcript from a chat file with chat

down so basically what we want to do is

just say okay what does our users name

gonna be that's gonna be me we're gonna

say what is our BOTS name gonna be

that's gonna be demo BOTS I guess and

then basically it's as easy as writing

back and forth what you want each person

to say it at one another I see yeah so

I'll say you know hey how's it going

demo a lot so it's a typo okay and then

demo BOTS gonna respond with hey hey I'm

doing really well what can I help typing

man typing is so hard we have BOTS that

speak hey I'm doing really well

what can I assist you with today and you

know I'm just gonna say oh I was just

wondering what you think of the demo so

far well you're a fast typer though it

helps you know and demo BOTS is going to

say you know well to be honest I think

this is probably the best the best demo

I've ever seen nice

you know demo BOTS really nice of course

and so we're gonna save this in our

folder here called we'll just call demo

dot chat so a chat file is what is

consumed by our tool chat down and chat

downs not included in the emulator but

you can install via NPM and stuff like

that's really easy so we can go back to

our folder here we can see the demo chat

is in there and all we have to do is

chat down the name of the chat file we

want to convert pipe it into the name of

the transcript file we want to generate

nice and then we just wait a little bit

and it's done set fast and then we go we

can see that demo transcript is in our

little File Explorer we can click that

boom there's the conversation nice so it

was even smarter than my dumb text file

idea right yeah I see like you thought

about yeah we thought about it you know

we have everything covered so a couple

of questions about this when you're

doing these wire is there a way to do

like the cards in line as well yeah so

you can so just for the sake of time I

just did a purely text-based demo but

yeah you can do you can send you a

little typing notifications and delays

and all so yeah rich content cards like

adaptive cards awesome

so what other features are gonna show um

so basically some of our we still have

some of our core functionality so I just

want to show you that you know let's

switch to another bot here actually oh

well actually before I do that let me

show you presentation mode so let's say

you know you just mocked up a real real

quick conversation you didn't have time

to work on this concept you were

thinking about but you wanted to show

your team

new bad idea would look like and so you

know you don't want to show them this UI

you want to show them boom this you know

presentation mode you just hit

presentation it goes into this

full-screen kind of cinematic mode and

it kind of just shows you just the focus

of the chat window so I love it so when

you're wireframing and showing the

stakeholders they can be like yeah I

totally love this conversation and then

and you can see how fast I just whipped

up that transcript and you know we went

from a text file to this in like two

minutes loved it so pretty fast okay so

let's go look at some of the other

functionality we have I'll open up this

cafe bot the cafe bot is running locally

so just to show you some of the core

functionality we still have I will show

you that we can still put breakpoints in

our code here so here's just the source

code and I'll just break on when we get

a response back from Louis and then I'll

talk to the bot Hey and now we can see

that we hit that breakpoint we can step

over and we can see the hey we got this

Louis result here with it's kind of

small but we got this Louis result with

all these entities and stuff like that

cool okay and then we'll just go through

that remove this breakpoint okay and

then some of the other functionality we

have is we can open two simultaneous

live chats at a time to the same bot so

that's pretty cool you can debug you

know side by side I can split this over

to the other tab and I can you know have

a little conversation over here and have

a completely you know conversation or a

completely independent conversation in

the left window that's nice so if you're

lonely you can open his video you can

you can feel like you're you know so

popular awesome that's how I'm gonna

feel okay and then one final thing we'll

show you guys is this new services tab

we have over here holy cow that's

amazing yeah so you can connect things

like Louis and Q&A maker and even to the

a Shabbat service with these services

and basically what you do is you you

know you just open this you type in the

name of your Louis app the application

ID the author and key version etc and

then you submit and now your bot can key

off of these new Louis traces so let's

take a look at this I already have Louis

hooked up to this so if we say you know

let's start over this conversation

and then I can just say you know hey and

if we look in this log over here to the

right we can see that oh we have this

new thing called a Lewis trace and so

now we can click on this Lewis trace and

in this inspector it has the model name

of my Lewis model it has the app ID and

it has all the results from Lois saying

oh here's what you scored here's the top

scoring intent okay and so well that's

super handy I mean like because usually

it just goes and it comes back and like

what happened and you got to look at the

logs over there but this is hooking

directly up to the service and then

getting all of the the logs alright so

it's no longer a black box that you just

kind of have to you know cross your

fingers and hope everything works out

which I do with all myself right and so

on the left here what's really cool is

that I'm you can click this Louis link

and it will deep link right into the

language model in the Lewis portal so

you can tweak your language models you

know right here in the Louis portal but

I know what you're saying you're saying

oh you know Tony I really don't want to

leave your beautiful new app that's

probably just saying no I didn't want to

yeah exactly we just gave it a such a

nice UI I don't want to leave it's so

it's so awesome and sleek and we're

saying okay yeah we kind of we kind of

feel that way too so what you can do now

is let's say we're gonna start over in

this conversation and we're gonna say

something like howdy partner to the bot

oh okay it actually understood that

howdy there

okay so it says sorry I do not

understand that so we're gonna go and

we're gonna click on this Lewis trace

and we're gonna see that it scored none

as the highest intent so what we're

gonna do is mark that as a greeting Wow

yeah and so now you'll see train light

up over here in the corner we can now

train training it was successful we can

now publish this model and so it just

went and published that so now if we

start over we should be able to say

howdy there

hello so it knows it's a greeting so

yeah that's something we're really

excited about and that's our new plug-in

model and a lot of developers are going

to be able to create these custom traces

that they'll be able to key off of and

present their own UI in the inspector

panel all right Tony thanks so much for

spending some time with us we'll be

learning all about the bot framework

emulator which is pretty cool you can do

ton of things in it thanks so much for

watching we'll see you next time take

care

[Music]