'Mobile ALOHA' is a low-cost yet extremely dexterous manipulator that can tie shoelaces, crack eggs, and cook.



Tony Z. Zhao , a student at Stanford University and a student researcher at Google DeepMind , Google's AI research and development division, is developing a low-cost, open-source manipulator called Mobile ALOHA . Mobile ALOHA is an extremely dexterous manipulator that can tie shoelaces, crack eggs, and cook.

Mobile ALOHA
https://mobile-aloha.github.io/

Various manipulators and robotic arms have been developed, but most of them are designed with a focus on 'tabletop operation', so they lack the 'mobility' and 'dexterity' that are useful for general work. Therefore, Zhao and his research team are developing a system that can mimic 'human bimanual whole-body control tasks', and as a first step, they have announced a low-cost open source manipulator 'Mobile ALOHA'.

According to the research team, by using the data collected by Mobile ALOHA to create an AI clone for manipulator operation using supervised learning and training it together with the existing Mobile ALOHA dataset, it is possible to improve the performance of the operation task in Mobile ALOHA.

They also explain that by conducting 50 demonstrations per task, the success rate of the task can be increased by up to 90% compared to normal training, and as a result, Mobile ALOHA can be used to perform actions such as cooking sauteed shrimp and turning on a kitchen faucet to rinse pots.

If you watch the video below, you'll immediately see just how useful Mobile ALOHA is.

Mobile ALOHA Robot - Teleoperating a 3-Course Cantonese Meal - YouTube


In the video, we use Mobile ALOHA to make three Chinese dishes. The first dish we make is 'Stir-fried shrimp and eggs.'



First, use one of the manipulators to lightly tap the egg on the table.



Then, he tapped one of the manipulators against the egg on the plate and skillfully cracked it.



Next, add the peeled shrimp to the boiling water.



When the shrimp change color, remove them from the pot.



Add beaten eggs to frying pan.



Then add the boiled shrimp and stir fry together to finish.



The second dish we will make is sauteed chicken.



Fry the chicken skin side down in a frying pan.



When I flipped it over with a spatula, the skin was nicely browned.



Once cooked on both sides, add ginger and green chillies.



Then add dried scallops that have been rehydrated in water.



Then add soy sauce, cover and simmer slowly for 20 minutes.



All that's left is to serve it on a plate.



Finally, sprinkle on some green onions and it's done.



The third menu item is 'Lettuce with Oyster Sauce.'



First, he uses two manipulators to handle a plastic bag and skillfully open it.



Hold the knife with one manipulator and hold the lettuce with the other, cutting off the root end.



Take boiling water and add the oil.



Next, add the lettuce.



When it's cooked, remove it.



Next, mince the garlic.



Add the garlic to a frying pan with oil and heat it while adding the soy sauce.



Next, add oyster sauce.



Mix thoroughly with a spatula.



Once the sauce is ready, pour it over the boiled lettuce and it's done.



The three dishes made by Mobile ALOHA are as follows. They look like they were made by robots alone.



Additionally, Zhao has posted videos of himself using Mobile ALOHA to tie shoelaces and hang a T-shirt.




First, replace the part at the tip of the broken robot arm (white).



Two black manipulators deftly remove the tip parts of the robot arm.




Then lift the replacement part off the desk.



Then, one manipulator is used to fix the tip of the robot arm, and the other is used to attach the replacement part.



Success!



Next, I tried tying my shoelaces.



The shoelaces are skillfully stretched using a manipulator.



Then, he skillfully hooks it onto the tip of a manipulator and ties the string together with the two manipulators like a cat's cradle.



I succeeded in tying a bow.



Finally, we will try hanging a T-shirt on a hanger.



First, he deftly stretches out a T-shirt that has been carelessly placed on the desk.



Take a hanger and insert one side of it through the collar.




By fixing the side where the hanger was inserted with a manipulator and using the manipulator to pull the sleeve on the other side, we were able to skillfully insert the hanger.




All you have to do is hang it on the pole and you're done.



In addition, Zhao and his research team have also released a video that compiles examples of Mobile ALOHA's failures, allowing you to enjoy the precious and clumsy moments of this dexterous robot.

Mobile ALOHA funny failures - YouTube


Related Posts:

in Hardware,   Science,   Video, Posted by logu_ii