We need your help now

Support from readers like you keeps The Journal open.

You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.

If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.

Peyri Herrera/Flickr

What happens when a robot doesn't know something? It just goes on the internet

The Robo Brain system will allow robots to use the internet to learn about objects and how they’re used, along with human language and behaviour.

BEFORE NOW, ROBOTS were either programmed to carry out tasks or taught what to do through learning algorithms, but in the future, they may just learn what to do from the internet instead.

Robo Brain is a large-scale computational system that learns from publicly available resources from the internet. The system was developed by researchers at Cornell, Stanford and Brown universities and the University of California, Berkeley.

According to Phys.org, the system is currently downloading and processing about one billion images, 120,000 YouTube videos and 100 million how-to documents and appliance manuals.

This data is being translated and stored in a robot-friendly format that robots will be able to draw upon when they need it. Robo Brain will process images to pick out the objects in them, and by connecting images and videos with text, it will learn to recognise objects and how they’re used, along with human language and behaviour.

This is all done through a process called “structured deep learning” which helps robots classify what objects are and how they’re interacted with. As Phys.org explains:

The system employs what computer scientists call “structured deep learning,” where information is stored in many levels of abstraction. An easy chair is a member of the class of chairs, and going up another level, chairs are furniture. Robo Brain knows that chairs are something you can sit on, but that a human can also sit on a stool, a bench or the lawn.

One of the examples given is that of a coffee mug. If Robo Brain sees this, it can learn that not only is it a mug, but liquids can be poured into it, you can use the handle to hold it and it must be carried upright when full.

Robo Brain will also have teachers, where its website will display things it has learned. Visitors will be able to view this information and make additions and corrections where required, although what they will teach them remains to be seen.

apala734 / YouTube

Read: Google tests its self-driving cars in a ‘Matrix-style’ virtual simulation >

Read: Here’s how you can give your Android device an extra layer of security >

Readers like you are keeping these stories free for everyone...
A mix of advertising and supporting contributions helps keep paywalls away from valuable information like this article. Over 5,000 readers like you have already stepped up and support us with a monthly payment or a once-off donation.

Close
9 Comments
    Install the app to use these features.
    Mute Glenard
    Favourite Glenard
    Report
    Jun 20th 2015, 7:35 PM

    What is with all these woman who want to have sex on the first date. It’s just not on!

    447
    Install the app to use these features.
    Mute Supernova
    Favourite Supernova
    Report
    Jun 20th 2015, 7:37 PM

    Tell me where these women are??

    333
    Install the app to use these features.
    Mute Glenard
    Favourite Glenard
    Report
    Jun 20th 2015, 7:43 PM

    There all in this big house I go to. You have to pay in but that covers the beer and there are all these half naked woman who just want to have sex when all I want is a few beers and a chat. I stopeed going because of it.

    338
    See 7 more replies ▾
    Install the app to use these features.
    Mute Supergran
    Favourite Supergran
    Report
    Jun 20th 2015, 7:46 PM

    I miss you Glenard, please call in again sometime.

    236
    Install the app to use these features.
    Mute Bearsass Hairyarse
    Favourite Bearsass Hairyarse
    Report
    Jun 20th 2015, 7:48 PM

    Ah thought I knew ya Mick. Jayzus we’re missin you!

    56
    Install the app to use these features.
    Mute Bearsass Hairyarse
    Favourite Bearsass Hairyarse
    Report
    Jun 20th 2015, 7:52 PM

    You just beat me to it Supergran. Miss you as wwll though hun. I’ll be back next week though when new dole claim comes through!

    55
    Install the app to use these features.
    Mute Supergran
    Favourite Supergran
    Report
    Jun 20th 2015, 7:53 PM

    xxx call me

    53
    Install the app to use these features.
    Mute Bearsass Hairyarse
    Favourite Bearsass Hairyarse
    Report
    Jun 20th 2015, 7:58 PM

    We just have! Ye don’t mind sharin?

    23
    Install the app to use these features.
    Mute Ben Redline
    Favourite Ben Redline
    Report
    Jun 20th 2015, 9:29 PM

    no seriously where is this place?

    44
    Install the app to use these features.
    Mute Ridiculous
    Favourite Ridiculous
    Report
    Jun 21st 2015, 3:35 AM

    Glenard,can i be your best friend?

    14
    Install the app to use these features.
    Mute Sean D
    Favourite Sean D
    Report
    Jun 22nd 2015, 4:28 AM

    Honestly have seldom read such generic ‘get the love of your life’ absolute crap as this. Straight out of one of Dr phil’s books. How about ‘whether online or on the land’ be yourself from the get go instead of trying to be an interesting fake listener. Better your found out now than in 5 years when you realise you’ve not been yourself.and hence living a costly lie. All the red thumbs, at least with the red, try to tell me I’m wrong.

    105
    Install the app to use these features.
    Mute Chris Jones
    Favourite Chris Jones
    Report
    Jun 21st 2015, 3:00 PM

    Heterosexuals could take some lessons from the gays. It’s time for a grindr-like app to go mainstream, where men and women can be honest that they just want a shag instead of wasting time with dinner.

    73
    Install the app to use these features.
    Mute Michael Sands
    Favourite Michael Sands
    Report
    Jun 21st 2015, 3:44 PM

    Many do after they get drunk?

    47
    Install the app to use these features.
    Mute Bulie Julie
    Favourite Bulie Julie
    Report
    Jun 22nd 2015, 7:56 AM

    Notions

    6
    See 1 more reply ▾
    Install the app to use these features.
    Mute Sternn
    Favourite Sternn
    Report
    Jun 22nd 2015, 8:03 AM

    Do you live under a rock? Grindr is a clone for the gay community based on Tinder which is exactly what you are describing.

    45
    Install the app to use these features.
    Mute Martello Mulligan
    Favourite Martello Mulligan
    Report
    Jun 20th 2015, 8:10 PM

    You have to subtly suggest that you have a huge one. It can be quite hard to get that into her head on the first date. But better hard than soft I suppose.

    47
    Install the app to use these features.
    Mute Gaeltán
    Favourite Gaeltán
    Report
    Jun 22nd 2015, 9:42 AM

    Abair léi go bhfaigheann tú 10% sa mbreis má dhéanann tú as Gaeilge é ;)

    11
    Install the app to use these features.
    Mute Cal Cryton
    Favourite Cal Cryton
    Report
    Jun 21st 2015, 1:52 PM

    Just because one third of marriages originate online, does not imply that online dating is “accepted”. Never will you find such a cess-pool of the filth, low lives and awkward freaks of society as you will find from an online dating service. There is a concentration effect of the worst of society. It will never be “accepted” as normal.

    41
    Install the app to use these features.
    Mute fact&ionlydealinfact
    Favourite fact&ionlydealinfact
    Report
    Jun 21st 2015, 4:43 PM

    Sounds like someone failed to get laid online.

    235
    Install the app to use these features.
    Mute Cal Cryton
    Favourite Cal Cryton
    Report
    Jun 21st 2015, 8:15 PM

    lol…i knew someone would come back with a line like that. I think you are confusing me for a desperate man who wants to get laid at any costs. I wouldnt want to go near most of those freaks of nature. Most are socially awkward and no doubt lack self esteem so sleep around at the drop of the hat and carry STD’s. So be careful my friend.

    21
    See 3 more replies ▾
    Install the app to use these features.
    Mute The Guru
    Favourite The Guru
    Report
    Jun 22nd 2015, 4:24 AM

    You sound like great craic Cal. Don’t worry I’m sure you’ll find “the one” soon…

    88
    Install the app to use these features.
    Mute Anne Marie Devlin
    Favourite Anne Marie Devlin
    Report
    Jun 22nd 2015, 8:11 AM

    Are one third of marriages really a result of online dating? I know only one couple who met online and that was due to online card playing and not a dating agency

    19
    Install the app to use these features.
    Mute Friendo Friendo
    Favourite Friendo Friendo
    Report
    Jun 22nd 2015, 8:38 AM

    Cal I dont know if you are talking about Irish Women or Irish Men.

    12
    Install the app to use these features.
    Mute Gaeltán
    Favourite Gaeltán
    Report
    Jun 22nd 2015, 7:57 AM

    An rud is tábhachtaí ná go bhfuil meas agus grá ort fhéin. Beidh tú sona ansin is cuma i d’aonair nó ceangailte thú. Bígí go deas libh fhéin. :))

    40
    Install the app to use these features.
    Mute Michael Sands
    Favourite Michael Sands
    Report
    Jun 21st 2015, 3:45 PM

    The size of the wallet helps as well as the flowing of the drink, when others pay for it…

    36
    Install the app to use these features.
    Mute Plantation Watch
    Favourite Plantation Watch
    Report
    Jun 22nd 2015, 8:19 AM

    Face is the only thing that matters.

    11
    Install the app to use these features.
    Mute Michael Sands
    Favourite Michael Sands
    Report
    Jun 23rd 2015, 10:46 PM

    But why do women go and see strippers then lol…

    1
    Install the app to use these features.
    Mute Steve McDermott
    Favourite Steve McDermott
    Report
    Jun 22nd 2015, 10:59 AM

    Pretty sure the more alcohol you consume the smarter and wittier your conversations become to women.

    16
    Install the app to use these features.
    Mute holden mcgroin
    Favourite holden mcgroin
    Report
    Jun 22nd 2015, 9:36 AM

    Oh PFO William Phelan, you look too creepy to be giving dating advice.

    2
Submit a report
Please help us understand how this comment violates our community guidelines.
Thank you for the feedback
Your feedback has been sent to our team for review.
JournalTv
News in 60 seconds