Hi, my name is sarah, and while I normally prefer to write code, I am writing this blog post to tell you all about a project I’ve been working on for the majority of the past year.Social learning and social cognitive theory this project is called cognimates, and it’s a platform for AI education that originated from an MIT media lab project. Our original platform was used in our research workshops with kids age 7–14 all around the world (read more about our research).Social learning and social cognitive theory through this experience, our team collected a lot of user feedback from children, and at the end of last year, we began to formulate a design to revamp the platform and grow it into a more sustainable, open-source project.Social learning and social cognitive theory

As part of my work on the cognimates team, I took the challenge of implementing our text training from end to end. The goal was to allow children to train their own machine learning models with examples of text.Social learning and social cognitive theory the first thing I had to do was to find a reliable API to support our text training backend. Previously, we had been using IBM watson which offered a limited free tier with only one free model.Social learning and social cognitive theory it was also slow, and their servers went down during several of our workshops, which was really getting in the way of kids having a good experience and learning.Social learning and social cognitive theory our goal was to find apis that have enough free options for kids, parents, and educator and which are backed by rigorous organizations. For our latest stack, we decided to use uclassify for text training, and I began to work on the implementation of this new setup.Social learning and social cognitive theory we later reach out to the uclassify team and they kindly agreed to also provide us with an academic free license to support our project. A quick rundown of the platform

social learning and social cognitive theory

After creating a project, you can go to the explore tab and play around with your projects by testing predictions on different phrases. You may also choose to launch our codelab from the training page and use your classifier there.Social learning and social cognitive theory if you are curious and excited to try and remake this project yourself, I made a video tutorial to help you learn how to create your first machine learning classier with text in cognimates step by step.Social learning and social cognitive theory

The cognimates codelab allows you to use visual blocks to programs where you can control characters on the screen or physical components like robots or electronics boards.Social learning and social cognitive theory this platform builds on top of scratch and is open source. Our codelab has several pre-trained machine learning extensions for sentiment analysis or speech recognition but it can also use custom machine learning models that users create in the training studio.Social learning and social cognitive theory

This project is using a custom text model trained to recognize the styles of kerouac, shakespeare, and tolkien so when the user types any text fragment it would predict which writer was the author of that text.Social learning and social cognitive theory writing samples for each writer can be added to train the model either from the blocks directly in the codelab or on the text training page by creating a new project and adding these training examples for each category.Social learning and social cognitive theory

Our interface for the training page was developed based on our experiences in the workshops we ran with children. We designed the interface to be simple and intuitive for new users.Social learning and social cognitive theory to train the “recognize a writer” classifier, we first need to create a new project. Then, we will create categories for the different writers and add at least 10 examples of text to each of the categories so the classifier has enough data to train on.Social learning and social cognitive theory

Once we finished adding the examples we can train and test the model. At this point, our text training page will send a request the uclassify API to use our project data and create a new classifier.Social learning and social cognitive theory the way calls are set up in this API is different from our platform flow. To preserve our flow and execute these different API calls efficiently for the data gathered from our platform, I ended up relying on async, which, was introduced to me by my teammate eesh likith.Social learning and social cognitive theory using this method, I learned how to create a function that creates functions (see line 207) from the request body in javascript then performs those functions.Social learning and social cognitive theory

After carefully crafting the ways we introduce the different steps and concepts on our training page, we began to tackle another challenge: transitioning seamlessly from our training platform to our codelab.Social learning and social cognitive theory while at the media lab, our founder stefania druga originally conceived the idea of creating cognimates while being a student in the lifelong kindergarten group which created scratch.Social learning and social cognitive theory the cognimates team has continued to work with the scratch team and built our codelab on top of the scratch stack before hacking the heck out of it with the goal of extending it for machine learning education.Social learning and social cognitive theory today, we continue to hack the heck out of it.

Our latest hack was transitioning from the training pages to the code lab and copying over API keys and the project name.Social learning and social cognitive theory before, users would have to copy and paste all of the same information used in training over to code lab in another tab, and this would get annoying.Social learning and social cognitive theory we wanted to see if we could make this step easier. We went in blind and guess and checked ways to correctly preload blocks into our code lab.Social learning and social cognitive theory what we ended up doing was passing in another script to our code lab that contained an “extension” (think of a scratch object that specifies a set of related drag and drop blocks) with the blocks pre-filled with the user’s API keys and models from the training platform.Social learning and social cognitive theory

During the time I was doing my internship at the media lab conducting kids workshops with my teammates tammy qiu and stefania druga, we changed blocks’ wording very often.Social learning and social cognitive theory we were trying to figure out what language was most appropriate for children. The less technical our blocks’ language was, the better. For example, instead of using something like “label this picture” or “get the class of this picture” we used “what do you see in the photo?”.Social learning and social cognitive theory

Examples of language we used for vision blockspersonally, I think a lot more thought goes into the way we word the blocks and our training platform than the actual coding.Social learning and social cognitive theory at least with coding, there’s usually a right answer somewhere on stack overflow. When trying to translate technical terms I see on a day to day basis into something ordinary people and children can understand, there’s not really a right answer, but there’s a best answer.Social learning and social cognitive theory I see it as me freaking out over microsoft acquiring github, then having my non-technical friends and parents ask “what is github?”. Well, mom, it’s kind of something I have to live and breathe with every day.Social learning and social cognitive theory keeping it weird

After the technical work, we get to have some fun with our team. My favorite cognimates characters (check out the characters we have added to the sprite library) are major tom and minor tom, and that’s only partially because I got to name them.Social learning and social cognitive theory major tom is the larger space panda, and I was inspired by one of my favorite songs, space oddity. Minor tom happens to be smaller, hence the minor in his name.Social learning and social cognitive theory they are also both very, very cute.

I am also very grateful for the challenge and the opportunity to learn how to think about my work and my interests in terms of something everyone can understand.Social learning and social cognitive theory it’s a step all developers should take to make their work more accessible, especially in explaining how machine learning works. While the education system tries to catch up on its offerings of tech (and AI) literacy, the best the tech industry can do is to find better ways to communicate and make transparent this big “black box” that machine learning is to the general public.Social learning and social cognitive theory it would support better regulations and critical use for machine learning algorithms used in the lives of everyone. At the very least, it will contribute to a more informed twitter debate when alexandria ocasio cortez brings up racism in machine learning algorithms.Social learning and social cognitive theory with our work, we aim to make a small dent and allow children and their parents to also learn how machine learning works by creating their own custom classifiers and using them in playful ways.Social learning and social cognitive theory ….. And the road ahead

This project has been a large part of my life in the past year, and I hope to see people from all walks of life learning playfully and creatively with our platform.Social learning and social cognitive theory in the past, we’ve had both graduate students prototyping designs with cognimates and kids as young as seven using it to predict whether a picture contained kirby, a dog, or sunglasses.Social learning and social cognitive theory on the other side of this project, we’ve also had tremendous support from the scratch team, uclassify, clarifai, the superrr network and mozilla, MIT sandbox, educators, and developers who have helped us prototype, test, and translate our work.Social learning and social cognitive theory this community continues to grow, and I hope that you, the reader, will join us on this journey as we try to create a future where playful learning with difficult concepts becomes a standard rather than the exception.Social learning and social cognitive theory