The Machine INtelligence Development (MIND) Lab at the American University of Beirut (AUB) aims at providing state of the art solutions in the field of Artificial Intelligence with a focus on machine learning theory and applications. The lab has recently established a new identity, grew in size, and saw great progress in cutting-edge research in two main domains: Natural Language Processing and Context-Aware Sensing.
As we begin a new year, we are extremely proud of the diligence and perseverance that our lab has shown despite the challenges that oversaw the world and Lebanon the past year. Our students were able to push cutting-edge research, produce publications, compete in local and global challenges, and share their expertise with the world through open-source solutions and invited talks.
2020 Research Manifesto
Natural Language Processing (NLP)
Our NLP focused team has explored a wide range of challenges, from conversational systems and Arabic as a low-resource language to studying human reading comprehension.
Gilbert Badaro, our lab’s newest Ph.D. graduate, has investigated multiple link prediction approaches and different natural language processing variations in order to try to link a large lexical Arabic Resource, SAMA, to English WordNet. In his work, he used a machine learning approach and developed training data using existing small-scale Arabic WordNet. His latest article is important because it provides publicly a large-scale sentiment lexical resource for Arabic, ArSenL 2.0, to enable more accurate sentiment mining models. It also presents a benchmark dataset to be used by other researchers in the field interested in automatically evaluating approaches for Arabic WordNet expansion.
Obeida ElJundi has focused on exploring human reading comprehension. Reading comprehension is not the result of one single process as was thought before the 1970s. Rather, psychologists realized that a combination of several complex cognitive processes is involved. Traditional NLP algorithms used nowadays (e.g., RNN) cover some aspects of the reading comprehension cognitive processes, such as attention and forgetting, but render other aspects unaccounted for. Obeida has been looking into studying how the human brain reads and comprehends written text will help reveal what is missing and improve the overall performance of NLP.
Wissam Antoun has recently defended his thesis on Arabic Transformers for NLU and chatbots. This year, he trained the first Arabic BERT model, AraBERT, alongside his colleague, Fady Baly. Wissam is now planning to explore newer and better models for language understanding and generation, and he is off to a great start! Wissam and Fady have started 2021 by releasing 10 new Arabic Transformer Models (AraGPT2, AraELECTRA & AraBERTv2) on AUB Mind Lab and Hugging Face Github repositories.
Nataly Dalal has worked on designing lifelong learning for chatbots in customer support, thus allowing them to continuously learn and accumulate knowledge on their own from support forums posted on the web. Lifelong learning aims at producing chatbots that are more accurate, robust, and human-like.
Christian Hokayem has focused the bulk of his research on conversational automated negotiation agents. With the goal of improving user experience in an automated sales setting, he investigated what empathy is and tried to find a way to incorporate it into agents’ language generation and decision-making models. In his work, he formulated the problem as a multi-objective reinforcement learning problem and taught the bot to maximize user experience (represented by sentiment) and sales price.
Tarek Naous, our newest master’s student, has started with research focused on enabling empathetic behavior in conversational agents for the Arabic Language with the global aim of making human-machine interactions more similar to human-human interactions. In 2020, he was able to release a dataset of empathetic conversations in Arabic and propose a neural-based model for generating empathetic responses. His work was published in WANLP 2020 and is currently in progress for further development, where the challenge is improving performance given the limited dataset size we have.
Context-Aware Sensing
With a focus on overcoming the challenge of learning from limited labeled data, our work in context-aware sensing has been versatile, ranging from applications of healthcare, such as traumatic brain injuries and epilepsy prediction, to power load forecasting and human activity recognition.
Reem Mahmoud’s research interest is in personalized Machine Learning, which branches into problems of learning with little labeled data and advancing traditional transfer learning methods. This past year, she has looked into overcoming challenges of catastrophic forgetting in pre-trained neural networks on time-series applications, such as human activity recognition. Her work looked into improving performance on target tasks with limited training data while preserving performance on source tasks from the pre-trained model. This work, titled “Multi-Objective Learning to Overcome Catastrophic Forgetting in Time-series Applications,” has been recently submitted to the journal of ACM Transactions on Knowledge Discovery from Data.
Marc Djandji has focused his research for the past year on improving the performance of deep learning models when trained with limited labeled training examples. He has specifically investigated the problem under the application of short-term load forecasting. His work looks into scalable multi-task learning methods.
This year, Alaa Khaddaj had completed an internship at Signal Kinetics (MIT Media Lab) under the supervision of Prof. Fadel Adib, where they developed an apparatus that can detect contaminated food or counterfeit products. The system used a generative model (variational autoencoder) to generalize to new unseen environments and a transfer learning scheme to learn from multiple experiments simultaneously. Alaa’s other line of research was to develop a domain adaptation model that can generalize a classifier between two similar domains that have some differences. For his final year project, his team developed an intelligent question-answering system for customer support. This work has been submitted as a journal paper.
Mosbah Aouad has worked on developing deep learning models for short-term load forecasting for residential houses, where the challenge is to deal with the high non-linearities present in the load data. To build a sensitive model to varying load patterns and large peaks in the data, he designed an attention mechanism to augment a sequence-to-sequence network to capture these variations. On the other side, his thesis work has focused on biomedical image analysis with the aim of predicting the survival rate of penetrating traumatic brain injury (pTBI) patients from brain CT scans analysis. He is designing a representation learning approach that captures relevant features reflecting the severity of pTBIs from CT scan analysis directly.
Open-source Solutions, Competitions & Other Activities
Beyond the efforts in research, we are proud of the efforts our team has put into sharing and pushing their expertise through participating in competitions, open-sourcing solutions, and delivering talks.
Here are some of our highlights from 2020:
-
- We launched our AUB MIND Lab’s Github Repository and a brand new website for the group.
- Amir Hussein, Rim Achour, and Fady Baly ranked 1st place at QICC Cybersecurity contest in Fake News Detection task.
- Alaa Khaddaj won Best Paper Award at IEEE ICIoT 2020.
- Obeida ElJundi and his work on hULMonA were featured in WIRED Middle East
- AraBERT by our alumnus, Wissam Antoun, and Fady Baly has been featured in MIT Technology Review Arabia
- Marc Djandji, Fady Baly, and Wissam Antoun ranked 2nd Place at 4th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT 4) in Hate and Offensive speech detection tasks – Marseille, France 2020
- Wissam Antoun invited by IWAN Research Group at King Saud University to deliver a talk titled “AraBERT: Pretraining, fine-tuning, applications and demo (In Arabic),” September 2020.
- Wissam Antoun invited by PyData Khobar Meetup to deliver a talk titled “AraBERT: Pretraining, use cases and future improvements,” May 2020.
2020 Graduates
-
- Dalia Jaber – M.E. in Electrical & Computer Engineering
- Wissam Antoun – M.E. in Electrical & Computer Engineering
- Amir Hussein – M.E. in Electrical & Computer Engineering
- Alaa Khaddaj – B.E. in Electrical & Computer Engineering
- Gilbert Badaro – Ph.D. in Electrical & Computer Engineering
- Raslan Kain – M.E. in Electrical & Computer Engineering
2020 List of Publications
Journal Papers
-
- R. Mahmoud, H. Hajj, F. Karameh, “A Systematic Approach to Multi-Task Learning from Time-series Data” Elsevier Applied Soft Computing, Vol. 96 (2020), 106586.
- G. Badaro, H. Hajj, N. Habash, “A Link Prediction Approach for Accurately Mapping a Large-Scale Arabic Lexical Resource to English WordNet,” ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 19, no. 6 (2020): 1-38.
- N. Abbas, S. Sharafeddine, H. Hajj, and Z. Dawy, “Price-Aware Traffic Splitting in D2D HetNets with Cost-Energy-QoE Tradeoffs,” Computer Networks, vol. 172, p. 107169, 2020.
- A. Hussein, M. Djandji, R. Mahmoud, M. Dhabi, H. Hajj, “Augmenting Deep Learning with Adversarial Training for Robust Prediction of Epilepsy Seizures” ACM Transactions on Computing for Healthcare, June 2020, Article 18.
- S. Taleb, A. Yeretzian, R. A. Jabr, and H. Hajj. “Optimization of building form to reduce incident solar radiation.” Journal of Building Engineering 28 (2020): 101025.
Conference Papers
-
- W. Antoun, F. Baly, H. Hajj, “AraBERT: Transformer-based Model for Arabic Language Understanding.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 9-15. 2020.
- T. Naous, C. Hokayem, H. Hajj, “Empathy-driven Arabic Conversational Chatbot,” Proceedings of the Fifth Arabic Natural Language Processing Workshop, December 2020, Barcelona, Spain (Online), pp 5-68.
- S. Taleb, A. Yeretzian, R. Jabr, H. Hajj, “Energy Optimization of Climate Adapted Buildings in an Urban Context: The Case of Subtropical Climate”, 35th PLEA Conference: Planning Post Carbon Cities, 1-3 September 2020 A Coruña, Spain.
- M. Djandji, F. Baly, W. Antoun, H. Hajj. “Multi-Task Learning using AraBert for Offensive Language Detection.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 97-101. 2020.
- O. ElJundi, M. Dhaybi, K. Mokadam, H. Hajj, and D. Asmar, “Resources and End-to-End Neural Network Models for Arabic Image Captioning,” In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications – Volume 5: VISAPP, 233-241, 2020, Valletta, Malta.
- A. Khaddaj, H. Hajj, “Representation Learning for Adversarial Domain Adaptation in Text Classification,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020. [Winner of best paper award]
- A. Maarouf, N. El Droubi, R. Morcel, H. Hajj, M. Saghir, and H. Akkary. “Optimized Distribution of an Accelerated Convolutional Neural Network across Multiple FPGAs.” In 2020 IEEE 28th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), pp. 235-235. IEEE, 2020.
- W. Antoun, F. Baly, R. Achour, A. Hussein, H. Hajj, “State of the Art Models for Fake News Detection Tasks,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020.
To discover our lab and potential opportunities, visit our site or stay up to date with our news on LinkedIn and Twitter.
Nice knowledge gaining article. This post is really the best on this valuable topic. Zonnepanelen installateur Bierbeek
I liked your article and I hope you will have many entries or more Zonnepanelen installateur Hasselt
Cool stuff you have and you keep overhaul every one of us Zonnepanelen installatie
Excellent effort to make this blog more wonderful and attractive. seo
CeraVe Moisturizing Cream: This rich, hydrating cream is a game-changer for dry skin. Packed with ceramides and hyaluronic acid, it absorbs quickly without greasiness. Users love its ability to provide all-day moisture, though those with oily skin might find it a bit heavy. Highly recommended for a daily moisturizer!
Beauty reviews
With a wide range of shades, this foundation provides excellent coverage and a soft matte finish. It controls oil effectively and lasts all day without feeling heavy. Perfect for normal to oily skin, it delivers a flawless look that feels lightweight and comfortable.
Olaplex No. 3 Hair Perfector
A staple for damaged hair, this treatment works wonders in just a few uses. Users report softer, shinier hair with reduced breakage. Although it’s on the pricier side, the results justify the investment, making it essential for anyone looking to restore their hair’s health.
The Body Shop Almond Milk Body Butter
This luxurious body butter deeply hydrates and leaves skin feeling velvety smooth. Its rich texture absorbs well, making it perfect for dry skin, especially in winter. Users adore the comforting scent, and it’s become a go-to for daily moisturization without being overly greasy.
Beauty reviews
This is my first time visit here. From the tons of comments on your articles,I guess I am not only one having all the enjoyment right here! agenolx login
Thanks for the blog loaded with so many information. Stopping by your blog helped me to get what I was looking for. agenolx link alternatif
This is my first time visit here ติดต่อสอบหวยบี
I might point out in which it is a a fantastic submit of your fantastic particular person, now i’m pleased to notice this kind of. gacorbos88
General visits recorded here are the most easy system to esteem your imperativeness, which is the motivation behind why I am taking off to the site conventional, examining for new, interesting information. Many, favor your heart! sartreotr.com
His or her shape of unrealistic tats were initially threatening. Lindsay utilized gun first basic, whereas this girl snuck outside by printer ink dog pen. I used absolutely sure the all truly on the shade, with the tattoo can be taken from the body shape. make an own temporary tattoo https://designed-forlife.com
Fumigation services in the UK provide specialized pest control solutions, targeting a wide range of pests such as insects, rodents, and termites. These services use controlled chemicals to fumigate enclosed areas, ensuring complete eradication of infestations. Fumigation is often used in industrial, commercial, and residential settings, following strict health and safety regulations. Reliable UK fumigation companies offer professional assessments and customized treatment plans for effective pest control. Fumigation Services Uk
Thank you for sharing your knowledge and expertise with the world.
Sòng bạc thú vị
Everything is very open with a clear description of the issues. It was truly informative. Your website is very helpful. Many thanks for sharing! I faced similar HP Instant Ink kind of issue last time, I am still searching for some proper solution.
Thank you for sharing your insights and expertise with the world.เข้าเล่นหวยมาเล
For those serious about underground detection, BR Detectors Dubai offers the best devices in the world – backed by 22 years of experience! metal detectors
Digital Facts Your Guide to Digital Mastery: Whether you’re a beginner or a seasoned pro, our blog offers valuable content to sharpen your digital skills. From in-depth tech guides to success stories, we’re here to help you achieve digital excellence in all areas of your life.
Tiblor stands as your best resource for reliable information across a spectrum of subjects. From general knowledge to specialized content, our articles are designed to empower you to make informed decisions and enrich your understanding of the world around you.
Cage of Life is your guide to mastering the art of balanced living. From wellness tips to personal growth, we offer fresh perspectives to help you break free from the ordinary and thrive. Explore, evolve, and embrace life’s journey—one mindful step at a time.
Cosmic Globe Expert stands at the intersection of technology and finance, empowering businesses to harness the power of data-driven insights. With a focus on bespoke solutions, we help organizations enhance their operational efficiency, minimize risks, and maximize profitability.
What a fabulous post this has been. Never seen this kind of useful post. I am grateful to you and expect more number of posts like these. Thank you very much. AARP Mahjongg
Thank you for sharing your knowledge and expertise with the world.สมัคร หวย หุ้น เกาหลี
The AUB MIND Lab’s 2020 in Review highlights a year of groundbreaking research and innovation. Much like the iconic ryan gosling ken jean jacket, which became a cultural symbol in 2020, the lab’s achievements reflect both style and substance, pushing the boundaries of knowledge while staying relevant to the evolving world around us.
I work for a company that is wanting to e-mail some of our media contacts from our Press Release blog posts. The main problem I am running into is finding a service that doesn’t require opt-in. Does anybody have any suggestions?. api288
This is a brilliant blog! I’m very happy with the comments!.. 네네생중계TV
Thank you for sharing a bunch of this quality contents, I have bookmarked your blog. Please also explore advice from my site. I will be back for more quality contents. rakuten profile
faridabadlatestnews.com एक ऑनलाइन समाचार वेबसाइट है, जो फरीदाबाद और आसपास के क्षेत्रों की ताज़ा ख़बरों को कवर करती है। यह प्लेटफ़ॉर्म स्थानीय समाचारों के साथ-साथ राजनीति, अपराध, खेल, और मौसम से जुड़ी महत्वपूर्ण जानकारी प्रदान करता है। इसका उद्देश्य फरीदाबाद के निवासियों को समय पर, सटीक और विश्वसनीय समाचार उपलब्ध कराना है।
इस वेबसाइट पर आपको ब्रेकिंग न्यूज़, स्थानीय घटनाओं, और फरीदाबाद के दैनिक जीवन से संबंधित हर प्रकार की जानकारी मिलती है, जिससे लोग अपने शहर के बारे में जागरूक रह सकें।
Nusantara Post articles Post is an online media platform that provides news coverage with a focus on Indonesian and international topics. The site covers a wide range of subjects, including sports, culture, and politics. It aims to share timely news and information, with an emphasis on providing insight and updates on both domestic and global events.
The website uses SSL encryption to secure data exchange, but some reports suggest that it operates with hidden ownership details, which could raise concerns about transparency. Additionally, it has a relatively low web traffic ranking, which could be attributed to its status as a smaller or emerging platform.
That is really nice to hear. thank you for the update and good luck. Aneka88
Your article has opened my eyes to new possibilities and perspectives. trang cá cược bóng đá
hello!,I really like your writing so a lot! percentage we keep up a correspondence extra about your article on AOL? I require an expert on this area to unravel my problem. Maybe that’s you! Taking a look ahead to look you. 딥포커
Thank you for this very informative article! I would also like to introduce Diavnet, a leading web agency known for its expertise in web development and website creation in Morocco. We specialize in création site web Marrakech, offering tailored solutions for local businesses. Feel free to check out our services for more details!
I really like your blog. Great article. It’s most evident, people should learn before they are able to 라이브스포츠중계
Your article has sparked a conversation that I believe is important and necessary. Máy quay hũ
Your article has opened my eyes to new possibilities and perspectives.
keno minh chinh
great writing with quality content. computer aided solicitation of a minor A criminal lawyer defends individuals and organizations accused of illegal activities, ensuring fair trials and providing legal counsel. They handle cases ranging from minor violations to serious felonies.
We are tied directly into the sate’s renewal database which allows us to process your request almost instantly slot online
I am grateful for the depth of thought and research that went into your article. bài cào
You should know that Your article is an inspiration to many people หวย ฮานอย ruay
Thank you for your very good information and respond to you. san jose car dealers situs judi slot
Your article not only provided valuable information but also sparked introspection and reflection on my part. trang cá cược bóng đá
You should know that Your article is an inspiration to many people ติดต่อหวยลาวพัฒนา
Used to do delight in examining articles or blog posts placed here. There’re outstanding possesses many practical facts. situs judi bola
Your article has left an indelible mark on me, and I am grateful for the experience.ติดต่อหวยเกาหลี
Fryd Extracts is revolutionizing the world of disposable vapes with its commitment to providing an exceptional vaping experience. Fryd delivers premium products through a meticulous extraction process for those who demand convenience and quality, ensuring every puff is smooth, potent, and flavorful. Fryd’s commitment to quality is unmatched. They source the best cannabis oil and balance terpenes and cannabinoids carefully, ensuring maximum effect.
Such a very useful article. Very interesting to read this article.I would like to thank you for the efforts you had made for writing this awesome article. Nu-isoleren.be
I have express a few of the articles on your website now, and I really like your style of blogging. I added it to my favorite’s blog site list and will be checking back soon… Sempris.be
I am genuinely thankful to the holder of this web page who has shared this wonderful paragraph at at this place Aquapura.nl
I see some amazingly important and kept up to length of your strength searching for in your on the site Zonnenapenelen-installateur.be