Select Page

Getting computers to understand us: Are we almost there?

Feb 3, 2021 | 2020 ISSUE, RESEARCH

Getting computers to understand us: Are we almost there?

2020 ISSUE, RESEARCH

Written by Malek Succar

Imagine you walk into a store to get some baby formula for your newborn, or a perfume for a loved one. A thought then strikes your mind: what if they were contaminated or counterfeit? Luckily, you have brought your wireless contamination detector with you. Now, this might seem like a scene from the year 2050, but researchers at MIT, in addition to Alaa Khaddaj, an MSFEA ECE student, have developed a prototype this past summer. This device, which achieved a 95% accuracy, utilizes machine learning. This is just one example of how machine learning is becoming the standard in modern day technology, making it one of the trendiest scientific topics in recent years. The increased hype that this “next big thing” generated has attracted Alaa to begin undergraduate research at the start of his 2nd year at AUB with Professor Hazem Hajj in a unique and fascinating area: natural language processing of arabic text.
The topic of the research is mainly centered on sentiment analysis of arabic texts, and is applied to tweets extracted from the Levantine region (Lebanon, Palestine, Syria and Jordan). The goal of the project was to infer opinions and emotions from tweets, which is a highly subjective and challenging task. The first step in this process was to gather the data. After collecting more than 4000 Arabic tweets, the dataset was created and annotated based on topics (sports, politics, religion, etc.), emotions (very negative to very positive), as well as the regions. Consequently, Alaa and Professor Hazem developed a machine learning model that could accurately predict the sentiment of the tweets; however, they still needed to improve predictions pertaining to identifying the topic of the tweet. In order to do so, they worked on domain adaptation, which is basically transferring the knowledge from one task to another task.
Alaa thus proposed the usage of a new deep learning model called DARL, which is based on a combination of autoencoder and adversarial training, beating state-of-the art models at that time.

The research had major outcomes, such as creating an Arabic Tweets dataset that did not exist beforehand. This contribution is significant given that the Levantine region has fewer digital resources and less investment in research compared to the rest of the world. In addition, the development of advanced machine learning models for domain adaptation and transfer learning has a great impact, not only in analyzing Arabic text, but in a wide range of tasks across multiple languages. Creating datasets from scratch can be very costly and time consuming, but the more groundbreaking advancement is developing the capability to transfer information used in one task to another via these new transfer learning models.

Knowing that machine learning is still a complex Blackbox model, Alaa seeks to fully understand machine learning operations and the logical process behind it, beyond just the mathematics involved, by pursuing graduate studies at MIT. He strongly believes that through research, you can get a genuine sense of accomplishment by contributing to the science community and to the world. Whether in health care, finance, engineering, or any other domain, machine learning, if applied prudently, is likely to impact all parts of our lives, thus further extending the depths and breadths of human technological capabilities.
The incorporation of all the parts together portrays a seamless automated system, mimicking the operations of a factory, which is evident in the project’s name. The team believes that the collaboration with other institutions adds another dimension by substantially benefitting from the researchers’ knowledge and expertise, which further contributes to the IPF project as a whole.

Related Articles

Related

Word From Faculty Member

Word from faculty member... Like all of you, we find ourselves in a new world this Spring, trying to adjust to the reality of life during the COVID-19 pandemic in Lebanon and all over the world. While the landscape is changing daily, as of this writing on May 04,...

read more

Editorial Note

Dear readers, In the midst of fighting for a better future, surviving a pandemic and coping with the distress of the 4th of August explosion, MSFEA students across all majors attempted to channel their energy into a productive and positive mindset. Whether it was...

read more