The Machine INtelligence Development (MIND) Lab at the American University of Beirut (AUB) aims at providing state of the art solutions in the field of Artificial Intelligence with a focus on machine learning theory and applications. The lab has recently established a new identity, grew in size, and saw great progress in cutting-edge research in two main domains: Natural Language Processing and Context-Aware Sensing.
As we begin a new year, we are extremely proud of the diligence and perseverance that our lab has shown despite the challenges that oversaw the world and Lebanon the past year. Our students were able to push cutting-edge research, produce publications, compete in local and global challenges, and share their expertise with the world through open-source solutions and invited talks.
2020 Research Manifesto
Natural Language Processing (NLP)
Our NLP focused team has explored a wide range of challenges, from conversational systems and Arabic as a low-resource language to studying human reading comprehension.
Gilbert Badaro, our lab’s newest Ph.D. graduate, has investigated multiple link prediction approaches and different natural language processing variations in order to try to link a large lexical Arabic Resource, SAMA, to English WordNet. In his work, he used a machine learning approach and developed training data using existing small-scale Arabic WordNet. His latest article is important because it provides publicly a large-scale sentiment lexical resource for Arabic, ArSenL 2.0, to enable more accurate sentiment mining models. It also presents a benchmark dataset to be used by other researchers in the field interested in automatically evaluating approaches for Arabic WordNet expansion.
Obeida ElJundi has focused on exploring human reading comprehension. Reading comprehension is not the result of one single process as was thought before the 1970s. Rather, psychologists realized that a combination of several complex cognitive processes is involved. Traditional NLP algorithms used nowadays (e.g., RNN) cover some aspects of the reading comprehension cognitive processes, such as attention and forgetting, but render other aspects unaccounted for. Obeida has been looking into studying how the human brain reads and comprehends written text will help reveal what is missing and improve the overall performance of NLP.
Wissam Antoun has recently defended his thesis on Arabic Transformers for NLU and chatbots. This year, he trained the first Arabic BERT model, AraBERT, alongside his colleague, Fady Baly. Wissam is now planning to explore newer and better models for language understanding and generation, and he is off to a great start! Wissam and Fady have started 2021 by releasing 10 new Arabic Transformer Models (AraGPT2, AraELECTRA & AraBERTv2) on AUB Mind Lab and Hugging Face Github repositories.
Nataly Dalal has worked on designing lifelong learning for chatbots in customer support, thus allowing them to continuously learn and accumulate knowledge on their own from support forums posted on the web. Lifelong learning aims at producing chatbots that are more accurate, robust, and human-like.
Christian Hokayem has focused the bulk of his research on conversational automated negotiation agents. With the goal of improving user experience in an automated sales setting, he investigated what empathy is and tried to find a way to incorporate it into agents’ language generation and decision-making models. In his work, he formulated the problem as a multi-objective reinforcement learning problem and taught the bot to maximize user experience (represented by sentiment) and sales price.
Tarek Naous, our newest master’s student, has started with research focused on enabling empathetic behavior in conversational agents for the Arabic Language with the global aim of making human-machine interactions more similar to human-human interactions. In 2020, he was able to release a dataset of empathetic conversations in Arabic and propose a neural-based model for generating empathetic responses. His work was published in WANLP 2020 and is currently in progress for further development, where the challenge is improving performance given the limited dataset size we have.
Context-Aware Sensing
With a focus on overcoming the challenge of learning from limited labeled data, our work in context-aware sensing has been versatile, ranging from applications of healthcare, such as traumatic brain injuries and epilepsy prediction, to power load forecasting and human activity recognition.
Reem Mahmoud’s research interest is in personalized Machine Learning, which branches into problems of learning with little labeled data and advancing traditional transfer learning methods. This past year, she has looked into overcoming challenges of catastrophic forgetting in pre-trained neural networks on time-series applications, such as human activity recognition. Her work looked into improving performance on target tasks with limited training data while preserving performance on source tasks from the pre-trained model. This work, titled “Multi-Objective Learning to Overcome Catastrophic Forgetting in Time-series Applications,” has been recently submitted to the journal of ACM Transactions on Knowledge Discovery from Data.
Marc Djandji has focused his research for the past year on improving the performance of deep learning models when trained with limited labeled training examples. He has specifically investigated the problem under the application of short-term load forecasting. His work looks into scalable multi-task learning methods.
This year, Alaa Khaddaj had completed an internship at Signal Kinetics (MIT Media Lab) under the supervision of Prof. Fadel Adib, where they developed an apparatus that can detect contaminated food or counterfeit products. The system used a generative model (variational autoencoder) to generalize to new unseen environments and a transfer learning scheme to learn from multiple experiments simultaneously. Alaa’s other line of research was to develop a domain adaptation model that can generalize a classifier between two similar domains that have some differences. For his final year project, his team developed an intelligent question-answering system for customer support. This work has been submitted as a journal paper.
Mosbah Aouad has worked on developing deep learning models for short-term load forecasting for residential houses, where the challenge is to deal with the high non-linearities present in the load data. To build a sensitive model to varying load patterns and large peaks in the data, he designed an attention mechanism to augment a sequence-to-sequence network to capture these variations. On the other side, his thesis work has focused on biomedical image analysis with the aim of predicting the survival rate of penetrating traumatic brain injury (pTBI) patients from brain CT scans analysis. He is designing a representation learning approach that captures relevant features reflecting the severity of pTBIs from CT scan analysis directly.
Open-source Solutions, Competitions & Other Activities
Beyond the efforts in research, we are proud of the efforts our team has put into sharing and pushing their expertise through participating in competitions, open-sourcing solutions, and delivering talks.
Here are some of our highlights from 2020:
-
- We launched our AUB MIND Lab’s Github Repository and a brand new website for the group.
- Amir Hussein, Rim Achour, and Fady Baly ranked 1st place at QICC Cybersecurity contest in Fake News Detection task.
- Alaa Khaddaj won Best Paper Award at IEEE ICIoT 2020.
- Obeida ElJundi and his work on hULMonA were featured in WIRED Middle East
- AraBERT by our alumnus, Wissam Antoun, and Fady Baly has been featured in MIT Technology Review Arabia
- Marc Djandji, Fady Baly, and Wissam Antoun ranked 2nd Place at 4th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT 4) in Hate and Offensive speech detection tasks – Marseille, France 2020
- Wissam Antoun invited by IWAN Research Group at King Saud University to deliver a talk titled “AraBERT: Pretraining, fine-tuning, applications and demo (In Arabic),” September 2020.
- Wissam Antoun invited by PyData Khobar Meetup to deliver a talk titled “AraBERT: Pretraining, use cases and future improvements,” May 2020.
2020 Graduates
-
- Dalia Jaber – M.E. in Electrical & Computer Engineering
- Wissam Antoun – M.E. in Electrical & Computer Engineering
- Amir Hussein – M.E. in Electrical & Computer Engineering
- Alaa Khaddaj – B.E. in Electrical & Computer Engineering
- Gilbert Badaro – Ph.D. in Electrical & Computer Engineering
- Raslan Kain – M.E. in Electrical & Computer Engineering
2020 List of Publications
Journal Papers
-
- R. Mahmoud, H. Hajj, F. Karameh, “A Systematic Approach to Multi-Task Learning from Time-series Data” Elsevier Applied Soft Computing, Vol. 96 (2020), 106586.
- G. Badaro, H. Hajj, N. Habash, “A Link Prediction Approach for Accurately Mapping a Large-Scale Arabic Lexical Resource to English WordNet,” ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 19, no. 6 (2020): 1-38.
- N. Abbas, S. Sharafeddine, H. Hajj, and Z. Dawy, “Price-Aware Traffic Splitting in D2D HetNets with Cost-Energy-QoE Tradeoffs,” Computer Networks, vol. 172, p. 107169, 2020.
- A. Hussein, M. Djandji, R. Mahmoud, M. Dhabi, H. Hajj, “Augmenting Deep Learning with Adversarial Training for Robust Prediction of Epilepsy Seizures” ACM Transactions on Computing for Healthcare, June 2020, Article 18.
- S. Taleb, A. Yeretzian, R. A. Jabr, and H. Hajj. “Optimization of building form to reduce incident solar radiation.” Journal of Building Engineering 28 (2020): 101025.
Conference Papers
-
- W. Antoun, F. Baly, H. Hajj, “AraBERT: Transformer-based Model for Arabic Language Understanding.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 9-15. 2020.
- T. Naous, C. Hokayem, H. Hajj, “Empathy-driven Arabic Conversational Chatbot,” Proceedings of the Fifth Arabic Natural Language Processing Workshop, December 2020, Barcelona, Spain (Online), pp 5-68.
- S. Taleb, A. Yeretzian, R. Jabr, H. Hajj, “Energy Optimization of Climate Adapted Buildings in an Urban Context: The Case of Subtropical Climate”, 35th PLEA Conference: Planning Post Carbon Cities, 1-3 September 2020 A Coruña, Spain.
- M. Djandji, F. Baly, W. Antoun, H. Hajj. “Multi-Task Learning using AraBert for Offensive Language Detection.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 97-101. 2020.
- O. ElJundi, M. Dhaybi, K. Mokadam, H. Hajj, and D. Asmar, “Resources and End-to-End Neural Network Models for Arabic Image Captioning,” In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications – Volume 5: VISAPP, 233-241, 2020, Valletta, Malta.
- A. Khaddaj, H. Hajj, “Representation Learning for Adversarial Domain Adaptation in Text Classification,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020. [Winner of best paper award]
- A. Maarouf, N. El Droubi, R. Morcel, H. Hajj, M. Saghir, and H. Akkary. “Optimized Distribution of an Accelerated Convolutional Neural Network across Multiple FPGAs.” In 2020 IEEE 28th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), pp. 235-235. IEEE, 2020.
- W. Antoun, F. Baly, R. Achour, A. Hussein, H. Hajj, “State of the Art Models for Fake News Detection Tasks,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020.
To discover our lab and potential opportunities, visit our site or stay up to date with our news on LinkedIn and Twitter.
Global Wiza Hub, your go-to source for global insights and knowledge. Stay informed and inspired with our reliable and engaging content. Explore endless possibilities with us!
Hello, I have browsed most of your posts. This post is probably where I got the most useful information for my research. Thanks for posting, maybe we can see more on this. Are you aware of any other websites on this subject. rtp slot gacor
A blog like yours should be earning much money from adsense..-.,” slot
That is a beneficial viewpoint, however isn’t make every sence whatsoever dealing with which mather. Any method thanks in addition to i had make an effort to share your current post straight into delicius but it surely is apparently an issue using your websites is it possible to you should recheck this. many thanks again. MGM4D
I felt very happy while reading this site. This was really very informative site for me. I really liked it. This was really a cordial post. Thanks a lot!. 쇼티비
Positive site, where did u come up with the information on this posting? I’m pleased I discovered it though, ill be checking back soon to find out what additional posts you include. agen togel
Thanks for taking the time to discuss this, I feel strongly that love and read more on this topic. If possible, such as gain knowledge, would you mind updating your blog with additional information? It is very useful for me. galan4d
You make so many great points here that I read your article a couple of times. Your views are in accordance with my own for the most part. This is great content for your readers. fufu4d
Thanks for sharing this information. I really like your blog post very much. You have really shared a informative and interesting blog post with people.. slot online
The organization prides itself on its commitment to customer satisfaction, offering personalized services tailored to meet the unique needs of each client. Texas Auctioneers not only conducts live auctions but also provides online auction options, catering to a broader audience and enhancing accessibility for bidders. Their comprehensive approach includes thorough appraisals, detailed cataloging, and strategic promotion, all designed to create a competitive bidding environment.
By fostering strong relationships with both sellers and buyers, Texas Auctioneers has established itself as a trusted partner in the auction process, consistently delivering exceptional outcomes and contributing to the vibrant auction landscape in Texas.
They’re delivered by the absolute best degree engineers will’s identity recognized for your polo dress making. You’ll discover polo Ron Lauren inside select exhibit which incorporate specific classes for men, ladies. agen togel
“OKVIP” is a premier online platform tailored for gaming enthusiasts. It offers a variety of features, including access to exclusive content, community forums, and competitive gaming events. Designed to enhance the gaming experience, OKVIP connects players with the latest updates and a supportive community OKVIP
This is such a great resource that you are providing and you give it away for free. I love seeing blog that understand the value. Im glad to have found this post as its such an interesting one! I am always on the lookout for quality posts and articles so i suppose im lucky to have found this! I hope you will be adding more in the future… cogil168
Im no expert, but I believe you just made an excellent point. You certainly fully understand what youre speaking about, and I can truly get behind that. ceria89 slot
I did take pleasure in studying posts published on this web site. They may be remarkable and contains plenty of beneficial details. situs judi togel
Thanks for making the honest attempt to speak about this. I believe very robust approximately it and want to read more. If it’s OK, as you gain more in depth wisdom, would you thoughts adding extra articles similar to this one with additional information? It might be extremely useful and useful for me and my friends. situs toto
The Lab by Blanc Doux Pad BenefitsGreen Flavonoid Pad is a skincare product designed to deliver concentrated benefits through a convenient pad format. Infused with green flavonoids, it helps to soothe and rejuvenate the skin while providing antioxidant protection. Ideal for brightening and calming, this pad is a great addition to any skincare routine for maintaining a healthy, radiant complexion.
Thanks for taking the time to discuss this, I feel strongly that love and read more on this topic. If possible, such as gain knowledge, would you mind updating your blog with additional information? It is very useful for me. login raja slot
A blog like yours should be earning much money from adsense.’~::- bandar toto macau
Pretty! This was a really wonderful post. 123bet ไลน์ Thank you for your provided information.
I found that site very usefull and this survey is very cirious, I ‘ ve never seen a blog that demand a survey for this actions, very curious… dewabet
Get the latest news with Azaad English! Visit our blog for timely updates and comprehensive coverage on current events and trends.azaadenglish news updates 2024 Stay informed about what’s happening globally in 2024—head over to our site for fresh news and insightful articles.
Thanks for sharing this information. I really like your blog post very much. You have really shared a informative and interesting blog post with people.. alexistogel
I wanted to thank you for this excellent read!! I definitely loved every little bit of it. I have you bookmarked your site to check out the new stuff you post. alexistogel
This is my first time i visit here. I found so many interesting stuff in your blog especially its discussion. From the tons of comments on your articles, I guess I am not the only one having all the enjoyment here keep up the good work togel hongkong
This is really fascinating, You are a very professional blogger. I’ve joined your rss feed and sit up for searching for more of your great post. Also, I have shared your site in my social networks! alexistogel
Alexistogel merupakan bandar toto macau resmi terpercaya yang menyediakan link alternatif login dan daftar akun secara cepat tanpa terkendala.
bandar toto macau
Best Digital Service is your trusted source for worldwide insights and knowledge. Stay inspired and up-to-date with our engaging and dependable content. Discover endless opportunities with us!
Free Spins Link is a trusted provider of Dice Dreams Free Rolls, offering players a convenient way to access bonus rolls and enhance their gameplay. With Free Spins Link, Dice Dreams enthusiasts can enjoy extra opportunities to play and win, making it a go-to source for daily rewards and game enhancements.
Alothman Law firm in Riyadh has handled numerous complex cases and earned a reputation for excellence in the legal industry. Clients trust the firm’s professionalism, dedication, and commitment to achieving favorable outcomes.
I am overpowered by your post with such a decent theme. Typically I visit your web journals and get refreshed through the data you incorporate yet the present blog would be the most obvious. Well done! alexistogel
I’m absolutely thrilled to share my experience after reading others’ comments and seeing the wonderful content here. Just like when I celebrated my university graduation, finding SEVlaser was a true highlight! The exciting introduction and their exceptional service made reserving time for myself a perfect gift. The positive stories from others convinced me to share my own joy. Check out Laser Hair Removal in Brooklyn
Informative content you can check Coin Tales Free Spins
Useful! Thanks for sharing. Check out this Event Agency Dubai for event related information and updates.
In the form of Inexperienced, Now i’m once and for good seeking via the internet just for articles or reviews which has been about help others. With thanks. rtp slot online
Get the latest news withhttps://www.tandem.edu.co/gobierno-escolar/#comment-1494051 English! Visit our blog for timely updates and comprehensive coverage on current events and trends. Stay informed about what’s happening globally in 2024—head over to our site for fresh news and insightful articles.
Get the latest news with http://sites.vmi.edu/terramc16/2015/11/04/diarios-del-peru/#comment-9099 English! Visit our blog for timely updates and comprehensive coverage on current events and trends. Stay informed about what’s happening globally in 2024—head over to our site for fresh news and insightful articles.
Any movies is normally outstanding. You’ve gotten a lot of particularly as good writers and singers. Document prefer you will the best quality about financial success. gacorbos88
There exist a couple of many different distinct levels among the California Weight loss program and each and every a person is pretty important. You’re procedure stands out as the the actual giving up with all the power. weight loss link situs slot
Founded in [year], our mission is to [core mission or goal], driven by a passion for [specific aspect of the industry or field]. Our team of experts combines deep industry knowledge with a hrf>…..http://crakhorse.cowblog.fr/poeme-de-chevaux-3179202.html<&to creativity, ensuring that we deliver outstanding results that exceed expectations.
Sure, I can help with that! To tailor the description to your needs, could you provide a bit more detail about what “hrfhttps://sites.stedwards.edu/mwier/2019/09/30/lets-get-ethical-6-ways-to-start-thinking-and-dressing-more-ethically-sustainably/#comment-23381<<?" is? For example, is it a company, a product, a concept, or something else? The more context you give, the better I can craft an appropriate "About" section.
Welcome to Stony Brook University, where innovation meets tradition in an electrifying blend of academic excellence and vibrant campus life! Nestled on the scenic North Shore of Long Island, hrf..& is not just a place to learn—it’s a place to thrive. With its cutting-edge research facilities, world-class faculty, and a commitment to nurturing bright minds, Stony Brook is a powerhouse of intellectual curiosity and groundbreaking discoveries.
Thank you for the update, very nice site ใลน์huaybee
Tongabezi is a luxury lodge located in Zambia, near the stunning Victoria Falls. Known for its breathtaking natural beauty and exceptional service, hrf >…http://blog.tongabezi.com/2012/11/newest-staff-member.html?sc=1723091431369#c2712137315426334186>…?offers a unique and intimate experience for travelers seeking a high-end safari and adventure retreat.
Sure, could you clarify what you mean by “about faculty”? Are you looking for a description of a hrf>…https://facultyoflanguage.blogspot.com/2019/06/the-speed-of-evolution-in-domestication.html?sc=1723052659093#c8230989813923365139>team, a summary of a faculty department, or something else? If you can provide a bit more context, I can tailor the information to your needs!