The Machine INtelligence Development (MIND) Lab at the American University of Beirut (AUB) aims at providing state of the art solutions in the field of Artificial Intelligence with a focus on machine learning theory and applications. The lab has recently established a new identity, grew in size, and saw great progress in cutting-edge research in two main domains: Natural Language Processing and Context-Aware Sensing.
As we begin a new year, we are extremely proud of the diligence and perseverance that our lab has shown despite the challenges that oversaw the world and Lebanon the past year. Our students were able to push cutting-edge research, produce publications, compete in local and global challenges, and share their expertise with the world through open-source solutions and invited talks.
2020 Research Manifesto
Natural Language Processing (NLP)
Our NLP focused team has explored a wide range of challenges, from conversational systems and Arabic as a low-resource language to studying human reading comprehension.
Gilbert Badaro, our lab’s newest Ph.D. graduate, has investigated multiple link prediction approaches and different natural language processing variations in order to try to link a large lexical Arabic Resource, SAMA, to English WordNet. In his work, he used a machine learning approach and developed training data using existing small-scale Arabic WordNet. His latest article is important because it provides publicly a large-scale sentiment lexical resource for Arabic, ArSenL 2.0, to enable more accurate sentiment mining models. It also presents a benchmark dataset to be used by other researchers in the field interested in automatically evaluating approaches for Arabic WordNet expansion.
Obeida ElJundi has focused on exploring human reading comprehension. Reading comprehension is not the result of one single process as was thought before the 1970s. Rather, psychologists realized that a combination of several complex cognitive processes is involved. Traditional NLP algorithms used nowadays (e.g., RNN) cover some aspects of the reading comprehension cognitive processes, such as attention and forgetting, but render other aspects unaccounted for. Obeida has been looking into studying how the human brain reads and comprehends written text will help reveal what is missing and improve the overall performance of NLP.
Wissam Antoun has recently defended his thesis on Arabic Transformers for NLU and chatbots. This year, he trained the first Arabic BERT model, AraBERT, alongside his colleague, Fady Baly. Wissam is now planning to explore newer and better models for language understanding and generation, and he is off to a great start! Wissam and Fady have started 2021 by releasing 10 new Arabic Transformer Models (AraGPT2, AraELECTRA & AraBERTv2) on AUB Mind Lab and Hugging Face Github repositories.
Nataly Dalal has worked on designing lifelong learning for chatbots in customer support, thus allowing them to continuously learn and accumulate knowledge on their own from support forums posted on the web. Lifelong learning aims at producing chatbots that are more accurate, robust, and human-like.
Christian Hokayem has focused the bulk of his research on conversational automated negotiation agents. With the goal of improving user experience in an automated sales setting, he investigated what empathy is and tried to find a way to incorporate it into agents’ language generation and decision-making models. In his work, he formulated the problem as a multi-objective reinforcement learning problem and taught the bot to maximize user experience (represented by sentiment) and sales price.
Tarek Naous, our newest master’s student, has started with research focused on enabling empathetic behavior in conversational agents for the Arabic Language with the global aim of making human-machine interactions more similar to human-human interactions. In 2020, he was able to release a dataset of empathetic conversations in Arabic and propose a neural-based model for generating empathetic responses. His work was published in WANLP 2020 and is currently in progress for further development, where the challenge is improving performance given the limited dataset size we have.
Context-Aware Sensing
With a focus on overcoming the challenge of learning from limited labeled data, our work in context-aware sensing has been versatile, ranging from applications of healthcare, such as traumatic brain injuries and epilepsy prediction, to power load forecasting and human activity recognition.
Reem Mahmoud’s research interest is in personalized Machine Learning, which branches into problems of learning with little labeled data and advancing traditional transfer learning methods. This past year, she has looked into overcoming challenges of catastrophic forgetting in pre-trained neural networks on time-series applications, such as human activity recognition. Her work looked into improving performance on target tasks with limited training data while preserving performance on source tasks from the pre-trained model. This work, titled “Multi-Objective Learning to Overcome Catastrophic Forgetting in Time-series Applications,” has been recently submitted to the journal of ACM Transactions on Knowledge Discovery from Data.
Marc Djandji has focused his research for the past year on improving the performance of deep learning models when trained with limited labeled training examples. He has specifically investigated the problem under the application of short-term load forecasting. His work looks into scalable multi-task learning methods.
This year, Alaa Khaddaj had completed an internship at Signal Kinetics (MIT Media Lab) under the supervision of Prof. Fadel Adib, where they developed an apparatus that can detect contaminated food or counterfeit products. The system used a generative model (variational autoencoder) to generalize to new unseen environments and a transfer learning scheme to learn from multiple experiments simultaneously. Alaa’s other line of research was to develop a domain adaptation model that can generalize a classifier between two similar domains that have some differences. For his final year project, his team developed an intelligent question-answering system for customer support. This work has been submitted as a journal paper.
Mosbah Aouad has worked on developing deep learning models for short-term load forecasting for residential houses, where the challenge is to deal with the high non-linearities present in the load data. To build a sensitive model to varying load patterns and large peaks in the data, he designed an attention mechanism to augment a sequence-to-sequence network to capture these variations. On the other side, his thesis work has focused on biomedical image analysis with the aim of predicting the survival rate of penetrating traumatic brain injury (pTBI) patients from brain CT scans analysis. He is designing a representation learning approach that captures relevant features reflecting the severity of pTBIs from CT scan analysis directly.
Open-source Solutions, Competitions & Other Activities
Beyond the efforts in research, we are proud of the efforts our team has put into sharing and pushing their expertise through participating in competitions, open-sourcing solutions, and delivering talks.
Here are some of our highlights from 2020:
-
- We launched our AUB MIND Lab’s Github Repository and a brand new website for the group.
- Amir Hussein, Rim Achour, and Fady Baly ranked 1st place at QICC Cybersecurity contest in Fake News Detection task.
- Alaa Khaddaj won Best Paper Award at IEEE ICIoT 2020.
- Obeida ElJundi and his work on hULMonA were featured in WIRED Middle East
- AraBERT by our alumnus, Wissam Antoun, and Fady Baly has been featured in MIT Technology Review Arabia
- Marc Djandji, Fady Baly, and Wissam Antoun ranked 2nd Place at 4th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT 4) in Hate and Offensive speech detection tasks – Marseille, France 2020
- Wissam Antoun invited by IWAN Research Group at King Saud University to deliver a talk titled “AraBERT: Pretraining, fine-tuning, applications and demo (In Arabic),” September 2020.
- Wissam Antoun invited by PyData Khobar Meetup to deliver a talk titled “AraBERT: Pretraining, use cases and future improvements,” May 2020.
2020 Graduates
-
- Dalia Jaber – M.E. in Electrical & Computer Engineering
- Wissam Antoun – M.E. in Electrical & Computer Engineering
- Amir Hussein – M.E. in Electrical & Computer Engineering
- Alaa Khaddaj – B.E. in Electrical & Computer Engineering
- Gilbert Badaro – Ph.D. in Electrical & Computer Engineering
- Raslan Kain – M.E. in Electrical & Computer Engineering
2020 List of Publications
Journal Papers
-
- R. Mahmoud, H. Hajj, F. Karameh, “A Systematic Approach to Multi-Task Learning from Time-series Data” Elsevier Applied Soft Computing, Vol. 96 (2020), 106586.
- G. Badaro, H. Hajj, N. Habash, “A Link Prediction Approach for Accurately Mapping a Large-Scale Arabic Lexical Resource to English WordNet,” ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 19, no. 6 (2020): 1-38.
- N. Abbas, S. Sharafeddine, H. Hajj, and Z. Dawy, “Price-Aware Traffic Splitting in D2D HetNets with Cost-Energy-QoE Tradeoffs,” Computer Networks, vol. 172, p. 107169, 2020.
- A. Hussein, M. Djandji, R. Mahmoud, M. Dhabi, H. Hajj, “Augmenting Deep Learning with Adversarial Training for Robust Prediction of Epilepsy Seizures” ACM Transactions on Computing for Healthcare, June 2020, Article 18.
- S. Taleb, A. Yeretzian, R. A. Jabr, and H. Hajj. “Optimization of building form to reduce incident solar radiation.” Journal of Building Engineering 28 (2020): 101025.
Conference Papers
-
- W. Antoun, F. Baly, H. Hajj, “AraBERT: Transformer-based Model for Arabic Language Understanding.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 9-15. 2020.
- T. Naous, C. Hokayem, H. Hajj, “Empathy-driven Arabic Conversational Chatbot,” Proceedings of the Fifth Arabic Natural Language Processing Workshop, December 2020, Barcelona, Spain (Online), pp 5-68.
- S. Taleb, A. Yeretzian, R. Jabr, H. Hajj, “Energy Optimization of Climate Adapted Buildings in an Urban Context: The Case of Subtropical Climate”, 35th PLEA Conference: Planning Post Carbon Cities, 1-3 September 2020 A Coruña, Spain.
- M. Djandji, F. Baly, W. Antoun, H. Hajj. “Multi-Task Learning using AraBert for Offensive Language Detection.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 97-101. 2020.
- O. ElJundi, M. Dhaybi, K. Mokadam, H. Hajj, and D. Asmar, “Resources and End-to-End Neural Network Models for Arabic Image Captioning,” In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications – Volume 5: VISAPP, 233-241, 2020, Valletta, Malta.
- A. Khaddaj, H. Hajj, “Representation Learning for Adversarial Domain Adaptation in Text Classification,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020. [Winner of best paper award]
- A. Maarouf, N. El Droubi, R. Morcel, H. Hajj, M. Saghir, and H. Akkary. “Optimized Distribution of an Accelerated Convolutional Neural Network across Multiple FPGAs.” In 2020 IEEE 28th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), pp. 235-235. IEEE, 2020.
- W. Antoun, F. Baly, R. Achour, A. Hussein, H. Hajj, “State of the Art Models for Fake News Detection Tasks,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020.
To discover our lab and potential opportunities, visit our site or stay up to date with our news on LinkedIn and Twitter.
Thanks for your time designed for advertisment a great very good guide! I noticed your internet-site ideal for a must have. It has splendid and even effective content articles. Compete the best get the job done! situs togel terpercaya
Your article not only provided valuable information but also sparked introspection and reflection on my part.
มาเล ย์ 4d วัน นี้
This is my first time here and I would love to read your content on your website. 123vip เข้าสู่ระบบ
Dickinson is celebrated for her unique style, which includes unconventional punctuation and capitalization, irregular rhyme schemes, and an innovative use of meter. Her poetry often explores themes of death, immortality, nature, and the inner workings of the human psyche.https://blogs.dickinson.edu/outing-club/2015/01/26/snowshoeing-at-kings-gap-131/#comment-324670
I recently came across this fantastic article while celebrating my engagement, and it was a delightful surprise! I discovered SEVlaser through a friend’s recommendation and decided to share my excitement here. The content was truly enlightening, and I loved reading others’ positive experiences. As a special gift, I’m reserving some time for a treatment at SEVlaser. Check out more at Laser Hair Removal in Glendale.
Thank you for sharing your passion and knowledge with the world. nỗ hu
awesome post. I’m a normal visitor of your web site and appreciate you taking the time to maintain the nice site. I’ll be a frequent visitor for a long time. ยี่ กี
Fashion is a dynamic and ever-evolving expression of personal and cultural identity. At its core, fashion is about more than just clothing; it’s a form of http://petitelunesbooks.cowblog.fr/les-liaisons-dangereuses-choderlos-de-laclos-2868439.htmlthat reflects who we are, our values, and our aspirations. It encompasses a wide range of elements, including style, trends, fabric, and color, and can vary greatly across different societies and subcultures.
We have sell some products of different custom boxes.it is very useful and very low price please visits this site thanks and please share this post with your friends. link alternatif agenplay88
Thank you for your dedication to advancing the conversation in [field or industry]. ban ca
Saat ini, banyak pilihan situs bandar togel online yang tersedia di internet. Namun, tidak semua situs togel online yang beredar di pasaran merupakan situs yang resmi dan terpercaya. Saat ini, salah satu situs togel online yang banyak diminati oleh para pecinta judi togel online adalah Alexistogel. Situs ini menawarkan berbagai keunggulan, termasuk layanan yang cepat dan aman, serta pilihan permainan togel yang lengkap dan menarik. Dengan reputasi yang baik dan pengalaman yang luas dalam industri perjudian online, Alexistogel menjadi pilihan yang tepat bagi para pemain togel yang mencari situs terpercaya untuk bertaruh.
Your content is fantastic and I enjoy reading it. Thanks for sharing the Blog.
This blog is very useful information for every one.rent a car banja luka
Hey there! Thanks for sharing such a wonderful blog, I really like it. please!
check mine and share your suggestion rent a car
“””St. Cloud State University (SCSU) is a public university located in St. Cloud, Minnesota. Established in 1869, it’s part of the Minnesota State Colleges and Universities (MinnState) system. With a focus on providing a comprehensive education, https://blog.stcloudstate.edu/hied/2020/01/13/invitation-to-dissertation-defense-melissa-ryan/comment-page-4/#comment-44500offers a wide range of undergraduate and graduate programs across various fields, including business, education, engineering, health sciences, and liberal arts.
“
Thanks for sharing amazing information keep posting.
Please visit my site rent a car aerodrom
Extremely fantastic post, thanks for the article.
Please visit my site rent a car cijene
Dickinson’s work challenges traditional poetic forms and conventions, making her a pioneering figure in American poetry. Her innovative use of language and form has inspired countless readers and writers, and her https://blogs.dickinson.edu/outing-club/2015/01/26/xc-ski-and-snowshoe-at-d-park/#comment-324636of complex themes continues to resonate with audiences today.
Thanks for the informative and helpful post, obviously in your blog everything is good.. animeflv
Welcome to Hailey Bouche, where expertise and creativity intertwine. We craft eloquent, insightful content to illuminate minds and enrich lives. With every word, we guide, inspire, and empower, transforming the mundane into the magnificent, ensuring each reader embarks on a journey of discovery and growth. Join us in this odyssey of knowledge.
Wow what a Great Information about World Day its very nice informative post. thanks for the post. These are extraordinary and possesses a great deal of valuable data.
https://jpkamsia.homes
Your article has sparked a conversation that I believe is important and necessary. bacarat
Awesome blog. I enjoyed reading your articles. This is truly a great read for me. I have bookmarked it and I am looking forward to reading new articles. Keep up the good work! GUDANGSLOT88
Thanks for such amazing content. Your blog was really worth reading.에볼루션 바카라사이트
Lodynet شاهد المسلسلات الهندية عبر الإنترنت وقم بتنزيلها مجانًا lodynet
Thank you again for all the knowledge you distribute,Good post. I was very interested in the article, it’s quite inspiring I should admit. I like visiting you site since I always come across interesting articles like this one.Great Job, I greatly appreciate that.Do Keep sharing! Regards, bandar togel
Lafayette is renowned for its https://sites.lafayette.edu/dke/2018/01/16/dke-accreditation/comment-page-108/#comment-512873, including the Festival International de Louisiane, which showcases a diverse array of music, art, and food from around the world. The city’s culinary scene is equally notable, with traditional dishes like gumbo, étouffée, and boudin reflecting its deep-rooted Cajun and Creole traditions.
Thank you very much for the sharing! COOL.. Family Desert Camp in Jaisalmer
Hello everyone, I want to provide interesting information about IT business consulting, you can get consultation with our professional agents in their fields to get direction and input of innovative ideas. You can contact my team at BTS89 Let Me Know If You Interest Or Want Ask More About Us And Our Company Website This is such awesome content i got to read after lot of time. Its so interesting as well as informative. I am sure everyone who read it got a lot to learn from it.
Thanks for sharing i want to read more of your good articles. Well done. Also visit my web blog ร้านติดฟิล์มรถยนต์
Our Ghostwriting Para eBooks can help you develop as a writer by turning even the most difficult concepts into clear and concise tales. They have an excellent attention to detail and a love of creating stories. Make quick contact with us, and together we can collaborate to produce a masterpiece you will be proud of.
We provide Dissertation Helper across all fields. Our professionals are well-known for producing high-quality work and providing prompt service. We provide dissertation services at an inexpensive price, so that every student may profit without worrying about their money. Grab this chance and let us help you complete your dissertation with remarkable quality.
This post actually provided a lot of useful information, thank you.
tarea อุบล
Thank you for the knowledge and experience shared, I feel helped and motivated in everything. Please let me know if there is a new update in my contact PANDACUAN
Practice exam papers are essential study tools that simulate real test conditions, helping students prepare effectively. They cover a range of topics, allowing learners to reinforce knowledge, familiarize themselves with question formats, and assess their understanding. Regular practice can boost confidence, improve time management, and ultimately enhance performance in actual exams.
Alexistogel adalah sebuah situs slot hoki terpercaya dan terbaik di Indonesia yang menawarkan berbagai jenis permainan slot gacor dengan RTP tinggi yang dapat memberikan keuntungan besar bagi para pemainnya. Dengan tema-tema yang menarik dan grafis yang menawan, Alexistogel menjadi pilihan utama bagi penikmat game slot online di seluruh Indonesia. Bonus dan promo menarik juga diberikan secara reguler untuk meningkatkan pengalaman bermain yang memuaskan bagi member.
Sebagai situs slot hoki terkemuka di Indonesia, kami berkomitmen menyediakan permainan slot yang beragam dan menguntungkan. Informasi tentang RTP Slot yang kami sajikan dirancang untuk meningkatkan peluang kemenangan Anda. Memilih Alexistogel berarti mempercayakan peruntungan Anda pada platform yang legal dan diakui oleh PAGCOR. Kami senantiasa mengikuti perkembangan terbaru dalam industri slot online untuk menawarkan pengalaman bermain yang menarik dan menantang bagi seluruh pemain kami.
Thanks for a wonderful share. Your article has proved your hard work and experience you have got in this field. Brilliant .i love it reading. situs slot gacor
Transform your space into a captivating haven with limelight decor. Focus on statement lighting, vibrant accent walls, and layered textures. Incorporate greenery and unique artwork for added personality. Use mirrors to enhance brightness, and opt for stylish storage solutions to keep the area organized yet visually appealing.
Limelight decor ideas
I appreciate the time and effort you invested in crafting such a thought-provoking piece.
bacarat
First You got a great blog .I will be interested in more similar topics. i see you got really very useful topics, i will be always checking your blog thanks. Monoblok zwembaden
Very nice article. I enjoyed reading your post. very nice share. I want to twit this to my followers. Thanks !. Zonnepanelen te Antwerpen
This is a fabulous post I seen because of offer it. It is really what I expected to see trust in future you will continue in sharing such a mind boggling post Zonnepanelen te Limburg
Great tips and very easy to understand. This will definitely be very useful for me when I get a chance to start my blog. Lucht lucht warmtepompen
First You got a great blog .I will be interested in more similar topics. i see you got really very useful topics, i will be always checking your blog thanks. Warmtepomp lucht water
Cool you write, the information is very good and interesting, I’ll give you a link to my site. Gevelbekleding
This is a fabulous post I seen because of offer it. It is really what I expected to see trust in future you will continue in sharing such a mind boggling post Crepi
Cool stuff you have and you keep overhaul every one of us Crepi gevel
I really enjoyed reading this post, big fan. Keep up the good work andplease tell me when can you publish more articles or where can I read more on the subject? Zwembaden op maat
My friend mentioned to me your blog, so I thought I’d read it for myself. Very interesting insights, will be back for more! Spouwisolatie
Regular visits listed here are the easiest method to appreciate your energy, which is why why I am going to the website everyday, searching for new, interesting info. Many, thank you! Aanleg zwembaden
wow, great, I was wondering how to cure acne naturally. and found your site by google, learned a lot, now i’m a bit clear. I’ve bookmark your site and also add rss. keep us updated. Zonnepanelen met batterijen