Advertisement

We need your help now

Support from readers like you keeps The Journal open.

You are visiting us because we have something you value. Independent, unbiased news that tells the truth. Advertising revenue goes some way to support our mission, but this year it has not been enough.

If you've seen value in our reporting, please contribute what you can, so we can continue to produce accurate and meaningful journalism. For everyone who needs it.

How a brain-like computer could be used to mark exams

It’s almost as accurate as a human.

TheJournal.ie / YouTube

NEURAL NETWORKS SOUND like science fiction at first.

They allow machines to ‘think’ like a human by using a pattern of inputs similar the synapses of a biological brain.

It can ‘learn’ by trying different methods to find the best way to achieve a desired result.

It cropped up in several projects at this year’s BT Young Scientist and Technology Exhibition. One by a student from St Mary’s College in Dublin used it as a method for correcting CSPE tests – and the marks were just a couple of percentage points off what the teacher gave.

This would be an easy task with multiple choice questions, but the code used had to decipher written sentences, such as the answer to ‘What is a coalition government?’, or tackle the students’ various attempts at spelling Leo Varadkar.

Aidan Dowling set up a mock exam in school with ten questions. The computer was fed a collection of potential answers, such as key phrases, correct and variations on the spelling, and it was then provided with the students answers. It compared these to the information it had and awarded a mark accordingly.

Compared to what the human marker was able to achieve, it was 97.5% accurate.

Aidan’s system still has a few stumbling blocks – Irish isn’t supported, and numbers and long answers still pose problems – but the current setup is designed for a quick, simple test, providing teachers with an instant result.

3Blue1Brown / YouTube

Neural networks are a hot topic right now as they prove their ability more and more. -Some even call them “unreasonably effective”.

Several projects featured the technology at the competition, including one by Sarah Sweeney, a student from Scoil Mhuire gan Smál in Cork with a passion for neural networks and AI.

photo5965488392374430532 Sarah at her stall.

Her project was The Imitation Game, based on exploring how to build a chatbot that could pass the Turing test.

This was devised by computer scientist Alan Turing in the 1950s to test how well a computer can mimic human langauge. Passing the test means a human is unable to tell  they are conversing with a machine.

“No one has actually managed to do it yet, but some has come very close,” Sarah explained enthusiastically, “and I just want to see how close I can get.”

How the computer learns language is described by Sarah as a similar to a newborn baby.

“When its born, it doesn’t know anything about language. As it listens to people around it talking, it starts to utter meaningless syllables, and eventually it learns its first word, and another, and another. At first, its rubbish, but eventually it starts to make sense.”

photo5965488392374430537

photo5965488392374430538

Two examples of how the machine’s language improved over time.

A neural network is similar, but requires a huge amount of training data. Sarah’s code, which is aimed at imitating Alan Turning himself, has 1,000 questions loaded into it. However, six million is normally what’s needed to made a decent stab at it.

“Despite this, I was amazed by how good it is,” Sarah said, “Some of the answers it gave were actually correct.”

“I plan to take it further, and see if I can think of any better ways of training, and I’d love to get into other areas of AI, such as natural language processing.”

Read: This young scientist had to explain Bitcoin to Michael D Higgins >

Close
5 Comments
This is YOUR comments community. Stay civil, stay constructive, stay on topic. Please familiarise yourself with our comments policy here before taking part.
Leave a Comment
    Install the app to use these features.
    Mute John Dman
    Favourite John Dman
    Report
    Jan 13th 2018, 5:31 PM

    Frances fitzgerald, Disgusting!

    17
    Install the app to use these features.
    Mute Fiona deFreyne
    Favourite Fiona deFreyne
    Report
    Jan 13th 2018, 5:39 PM

    @John Dman: we are not allowed discuss that topic. The position that the former Minister for Justice knew nothing of the conspiracy is untenable.

    12
    Install the app to use these features.
    Mute John Dman
    Favourite John Dman
    Report
    Jan 13th 2018, 6:15 PM

    @Fiona deFreyne: fine Gaels part in the conspiracy to label an honest, innocent honourable man as a paedophile, and wreck he’s career and life is Disgusting! Frances fitzgerald is Disgusting!

    15
    See 1 more reply ▾
    Install the app to use these features.
    Mute Johnny Mason
    Favourite Johnny Mason
    Report
    Jan 13th 2018, 6:18 PM

    @Fiona deFreyne: Conspiracy wow now that is a massive Statement and do you honestly think that a Tribunal will come to that decision never mind any Court in the Country for what it is worth love to see that your call is right

    1
    Install the app to use these features.
    Mute Dave Hammond
    Favourite Dave Hammond
    Report
    Jan 14th 2018, 12:13 PM

    could you fools please go away set up your own chat room and whinge away at each other on what ever topic you like without being completely off topic and filling up the comments section of an article about young scientific efforts of your next generation. idiots.

    4
Submit a report
Please help us understand how this comment violates our community guidelines.
Thank you for the feedback
Your feedback has been sent to our team for review.

Leave a commentcancel