Google builds AI agent that learns to generalize to new environments by ignoring distractions.
Google builds AI agent that learns to generalize to new environments by ignoring distractions.
Google builds AI agent that learns to generalize to new environments by ignoring distractions. In a study earlier this year accepted to the Genetic and Evolutionary Computation Conference (GECCO) 2020, Google researchers investigate the properties of AI software agents that employ self-attention bottlenecks. They claim that these agents not only demonstrate an aptitude for solving challenging vision-based tasks, but that they’re better at tackling slight modifications of the tasks, due to their blindness to details that might confuse them.
Inattentional blindness is the phenomenon that causes a person to miss things in plain sight; it’s a consequence of selective attention, a mechanism that’s believed to enable humans to condense information into a form compact enough for decision-making. Luminaries like Yann LeCun assert it can inspire the design of AI systems that better mimic the elegance and efficiency of biological organisms.
The Google researchers’ proposed agent — AttentionAgent — aims to devote most of its attention to task-relevant elements, ignoring distractions. To achieve this, the system segments input images into patches and relies on a self-attention architecture to “vote” on patches and elect a subset. The elected patches guide AttentionAgent’s actions as it keeps apprised of changes in the input data, tracking how important factors evolve over time.
In experiments, the team showed that AttentionAgent learned to attend to a range of regions in the images. For instance, they trained it to survive on a level within VizDoom, a digital research environment built on the first-person shooter game Doom, even in environments with walls, floor textures, and signage that it hadn’t encountered before. And on the CarRacing game within OpenAI’s Gym, a toolkit for developing and comparing reinforcement learning algorithms, AttentionAgent learned to drive during a sunny day and transfer its skills to driving at night, on a rainy day, in a different car, with brighter or darker scenery, and in the presence of visual artifacts. Perhaps more impressively, training in CarRacing required 1,000 times fewer parameters — the variables internal to the system that inform its predictions — than conventional methods that fail to generalize.
Despite the encouraging results, the researchers note AttentionAgent has serious limitations. It doesn’t generalize to cases where “dramatic” background changes are involved, for example; an agent trained on the CarRacing with a green grass background failed to generalize when the background was replaced with distracting YouTube videos. When the background was replaced with uniform noise, the agent attended to random patches of noise. And while training an agent from scratch with the noisy background enabled it to get around the track, its performance was mediocre.
Empower your team. Lead the industry
Get a subscription to a library of online courses and digital learning tools for your organization with EasyShiksha
Yes, all internships offered by EasyShiksha are completely free of charge.
Q.How can I apply for an internship with EasyShiksha?
You can apply for an internship with EasyShiksha by visiting our website and browsing through the available internship opportunities. Once you find a suitable internship, simply follow the application instructions provided.
Q.What types of internships are available through EasyShiksha?
EasyShiksha offers a wide range of internships across various industries and disciplines, including but not limited to technology, business, marketing, healthcare, and more. We continuously update our internship offerings to provide diverse opportunities for our users.
Q.Will I receive a certificate upon completing an internship?
Yes, upon successful completion of an internship with EasyShiksha, you will receive a certificate recognizing your participation and achievements during the internship period.
Q.Are EasyShiksha's internship certificates recognized by universities and employers?
Yes, EasyShiksha's internship certificates are recognized and valued by universities, colleges, and employers worldwide. They serve as a testament to your skills, knowledge, and experience gained through our internship programs.
Q.Is the download of certificates free or paid?
While access to internships and all courses on EasyShiksha is free for users lifetime, there is a nominal operational cost associated with downloading certificates. This fee covers the administrative expenses involved in processing and issuing the certificates.
Q.When can I start the course?
Anyone can choose a preferred course and start immediately without any delay.
Q.What are the course and session timings?
As this is a purely online course program, you can choose to learn at any time of the day and for as much time as you want. Though we follow a well-established structure and schedule, we recommend a routine for you as well. But it finally depends on you, as you have to learn.
Q.What will happen when my course is over?
If you have completed the course, you would be able to have lifetime access to it for future reference too.
Q.Can I download the notes and study material?
Yes, you can access and download the content of the course for the duration. And even have lifetime access to it for any further reference.
Q. What software/tools would be needed for the course and how can I get them?
All the software/tools that you need for the course would be shared with you during the training as and when you need them.
I’m unable to make a payment. What to do now?
You can try to make the payment through a different card or account (maybe a friend or family). If the problem persists, email us at info@easyshiksha.com
Q. Do I get the certificate in a hard copy?
No, only a soft copy of the certificate will be awarded, which can be downloaded and printed, if required.
Q. The payment got deducted, but the updated transaction status is showing “failed”. What to do now?
Due to some technical faults, this can happen. In such a case the amount deducted will be transferred to the bank account in the next 7-10 working days. Normally the bank takes this much time to credit the amount back into your account.
Q. The payment was successful but it still shows ‘Buy Now’ or not showing any videos on my dashboard? What should I do?
At times, there may be a slight delay in your payment reflecting on your EasyShiksha dashboard. However, if the problem is taking longer than 30 minutes, please let us know by writing to us at info@easyshiksha.com from your registered email id, and attach the screenshot of the payment receipt or transaction history. Soon after verification from the backend, we will update the payment status.
Q. What is the refund policy?
If you have enrolled, and are facing any technical problem then you can request a refund. But once the certificate has been generated, we shall not refund that..
Q.Can I just enrol in a single course?
Yes! You surely can. To begin this, just click the course of your interest and fill in the details to enrol. You are ready to learn, once the payment is made. For the same, you earn a certificate too.
My questions are not listed above. I need further help.
Please contact us at: info@easyshiksha.com
To motivate future, improved work in selective attention, the researchers released a suite of car racing tasks that involve environmental modifications. It’s now available in open source on GitHub. “The simplistic method we use to extract information from important patches may be inadequate for more complicated tasks,” wrote coauthors Yujin Tang, a research software engineer at Google, and David Ha, a staff research scientist at Google Research in Tokyo. “How we can learn more meaningful features, and perhaps even extract symbolic information from the visual input will be an exciting future direction.”
I hope you like this blog Google builds AI agent that learns to generalize to new environments by ignoring distractions, to learn more visit Hawkscode and Easyshiksha.
