The Machine INtelligence Development (MIND) Lab at the American University of Beirut (AUB) aims at providing state of the art solutions in the field of Artificial Intelligence with a focus on machine learning theory and applications. The lab has recently established a new identity, grew in size, and saw great progress in cutting-edge research in two main domains: Natural Language Processing and Context-Aware Sensing.
As we begin a new year, we are extremely proud of the diligence and perseverance that our lab has shown despite the challenges that oversaw the world and Lebanon the past year. Our students were able to push cutting-edge research, produce publications, compete in local and global challenges, and share their expertise with the world through open-source solutions and invited talks.
2020 Research Manifesto
Natural Language Processing (NLP)
Our NLP focused team has explored a wide range of challenges, from conversational systems and Arabic as a low-resource language to studying human reading comprehension.
Gilbert Badaro, our lab’s newest Ph.D. graduate, has investigated multiple link prediction approaches and different natural language processing variations in order to try to link a large lexical Arabic Resource, SAMA, to English WordNet. In his work, he used a machine learning approach and developed training data using existing small-scale Arabic WordNet. His latest article is important because it provides publicly a large-scale sentiment lexical resource for Arabic, ArSenL 2.0, to enable more accurate sentiment mining models. It also presents a benchmark dataset to be used by other researchers in the field interested in automatically evaluating approaches for Arabic WordNet expansion.
Obeida ElJundi has focused on exploring human reading comprehension. Reading comprehension is not the result of one single process as was thought before the 1970s. Rather, psychologists realized that a combination of several complex cognitive processes is involved. Traditional NLP algorithms used nowadays (e.g., RNN) cover some aspects of the reading comprehension cognitive processes, such as attention and forgetting, but render other aspects unaccounted for. Obeida has been looking into studying how the human brain reads and comprehends written text will help reveal what is missing and improve the overall performance of NLP.
Wissam Antoun has recently defended his thesis on Arabic Transformers for NLU and chatbots. This year, he trained the first Arabic BERT model, AraBERT, alongside his colleague, Fady Baly. Wissam is now planning to explore newer and better models for language understanding and generation, and he is off to a great start! Wissam and Fady have started 2021 by releasing 10 new Arabic Transformer Models (AraGPT2, AraELECTRA & AraBERTv2) on AUB Mind Lab and Hugging Face Github repositories.
Nataly Dalal has worked on designing lifelong learning for chatbots in customer support, thus allowing them to continuously learn and accumulate knowledge on their own from support forums posted on the web. Lifelong learning aims at producing chatbots that are more accurate, robust, and human-like.
Christian Hokayem has focused the bulk of his research on conversational automated negotiation agents. With the goal of improving user experience in an automated sales setting, he investigated what empathy is and tried to find a way to incorporate it into agents’ language generation and decision-making models. In his work, he formulated the problem as a multi-objective reinforcement learning problem and taught the bot to maximize user experience (represented by sentiment) and sales price.
Tarek Naous, our newest master’s student, has started with research focused on enabling empathetic behavior in conversational agents for the Arabic Language with the global aim of making human-machine interactions more similar to human-human interactions. In 2020, he was able to release a dataset of empathetic conversations in Arabic and propose a neural-based model for generating empathetic responses. His work was published in WANLP 2020 and is currently in progress for further development, where the challenge is improving performance given the limited dataset size we have.
Context-Aware Sensing
With a focus on overcoming the challenge of learning from limited labeled data, our work in context-aware sensing has been versatile, ranging from applications of healthcare, such as traumatic brain injuries and epilepsy prediction, to power load forecasting and human activity recognition.
Reem Mahmoud’s research interest is in personalized Machine Learning, which branches into problems of learning with little labeled data and advancing traditional transfer learning methods. This past year, she has looked into overcoming challenges of catastrophic forgetting in pre-trained neural networks on time-series applications, such as human activity recognition. Her work looked into improving performance on target tasks with limited training data while preserving performance on source tasks from the pre-trained model. This work, titled “Multi-Objective Learning to Overcome Catastrophic Forgetting in Time-series Applications,” has been recently submitted to the journal of ACM Transactions on Knowledge Discovery from Data.
Marc Djandji has focused his research for the past year on improving the performance of deep learning models when trained with limited labeled training examples. He has specifically investigated the problem under the application of short-term load forecasting. His work looks into scalable multi-task learning methods.
This year, Alaa Khaddaj had completed an internship at Signal Kinetics (MIT Media Lab) under the supervision of Prof. Fadel Adib, where they developed an apparatus that can detect contaminated food or counterfeit products. The system used a generative model (variational autoencoder) to generalize to new unseen environments and a transfer learning scheme to learn from multiple experiments simultaneously. Alaa’s other line of research was to develop a domain adaptation model that can generalize a classifier between two similar domains that have some differences. For his final year project, his team developed an intelligent question-answering system for customer support. This work has been submitted as a journal paper.
Mosbah Aouad has worked on developing deep learning models for short-term load forecasting for residential houses, where the challenge is to deal with the high non-linearities present in the load data. To build a sensitive model to varying load patterns and large peaks in the data, he designed an attention mechanism to augment a sequence-to-sequence network to capture these variations. On the other side, his thesis work has focused on biomedical image analysis with the aim of predicting the survival rate of penetrating traumatic brain injury (pTBI) patients from brain CT scans analysis. He is designing a representation learning approach that captures relevant features reflecting the severity of pTBIs from CT scan analysis directly.
Open-source Solutions, Competitions & Other Activities
Beyond the efforts in research, we are proud of the efforts our team has put into sharing and pushing their expertise through participating in competitions, open-sourcing solutions, and delivering talks.
Here are some of our highlights from 2020:
-
- We launched our AUB MIND Lab’s Github Repository and a brand new website for the group.
- Amir Hussein, Rim Achour, and Fady Baly ranked 1st place at QICC Cybersecurity contest in Fake News Detection task.
- Alaa Khaddaj won Best Paper Award at IEEE ICIoT 2020.
- Obeida ElJundi and his work on hULMonA were featured in WIRED Middle East
- AraBERT by our alumnus, Wissam Antoun, and Fady Baly has been featured in MIT Technology Review Arabia
- Marc Djandji, Fady Baly, and Wissam Antoun ranked 2nd Place at 4th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT 4) in Hate and Offensive speech detection tasks – Marseille, France 2020
- Wissam Antoun invited by IWAN Research Group at King Saud University to deliver a talk titled “AraBERT: Pretraining, fine-tuning, applications and demo (In Arabic),” September 2020.
- Wissam Antoun invited by PyData Khobar Meetup to deliver a talk titled “AraBERT: Pretraining, use cases and future improvements,” May 2020.
2020 Graduates
-
- Dalia Jaber – M.E. in Electrical & Computer Engineering
- Wissam Antoun – M.E. in Electrical & Computer Engineering
- Amir Hussein – M.E. in Electrical & Computer Engineering
- Alaa Khaddaj – B.E. in Electrical & Computer Engineering
- Gilbert Badaro – Ph.D. in Electrical & Computer Engineering
- Raslan Kain – M.E. in Electrical & Computer Engineering
2020 List of Publications
Journal Papers
-
- R. Mahmoud, H. Hajj, F. Karameh, “A Systematic Approach to Multi-Task Learning from Time-series Data” Elsevier Applied Soft Computing, Vol. 96 (2020), 106586.
- G. Badaro, H. Hajj, N. Habash, “A Link Prediction Approach for Accurately Mapping a Large-Scale Arabic Lexical Resource to English WordNet,” ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 19, no. 6 (2020): 1-38.
- N. Abbas, S. Sharafeddine, H. Hajj, and Z. Dawy, “Price-Aware Traffic Splitting in D2D HetNets with Cost-Energy-QoE Tradeoffs,” Computer Networks, vol. 172, p. 107169, 2020.
- A. Hussein, M. Djandji, R. Mahmoud, M. Dhabi, H. Hajj, “Augmenting Deep Learning with Adversarial Training for Robust Prediction of Epilepsy Seizures” ACM Transactions on Computing for Healthcare, June 2020, Article 18.
- S. Taleb, A. Yeretzian, R. A. Jabr, and H. Hajj. “Optimization of building form to reduce incident solar radiation.” Journal of Building Engineering 28 (2020): 101025.
Conference Papers
-
- W. Antoun, F. Baly, H. Hajj, “AraBERT: Transformer-based Model for Arabic Language Understanding.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 9-15. 2020.
- T. Naous, C. Hokayem, H. Hajj, “Empathy-driven Arabic Conversational Chatbot,” Proceedings of the Fifth Arabic Natural Language Processing Workshop, December 2020, Barcelona, Spain (Online), pp 5-68.
- S. Taleb, A. Yeretzian, R. Jabr, H. Hajj, “Energy Optimization of Climate Adapted Buildings in an Urban Context: The Case of Subtropical Climate”, 35th PLEA Conference: Planning Post Carbon Cities, 1-3 September 2020 A Coruña, Spain.
- M. Djandji, F. Baly, W. Antoun, H. Hajj. “Multi-Task Learning using AraBert for Offensive Language Detection.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 97-101. 2020.
- O. ElJundi, M. Dhaybi, K. Mokadam, H. Hajj, and D. Asmar, “Resources and End-to-End Neural Network Models for Arabic Image Captioning,” In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications – Volume 5: VISAPP, 233-241, 2020, Valletta, Malta.
- A. Khaddaj, H. Hajj, “Representation Learning for Adversarial Domain Adaptation in Text Classification,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020. [Winner of best paper award]
- A. Maarouf, N. El Droubi, R. Morcel, H. Hajj, M. Saghir, and H. Akkary. “Optimized Distribution of an Accelerated Convolutional Neural Network across Multiple FPGAs.” In 2020 IEEE 28th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), pp. 235-235. IEEE, 2020.
- W. Antoun, F. Baly, R. Achour, A. Hussein, H. Hajj, “State of the Art Models for Fake News Detection Tasks,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020.
To discover our lab and potential opportunities, visit our site or stay up to date with our news on LinkedIn and Twitter.
I precisely needed to thank you so much yet again. I do not know the things I would’ve taken care of without these secrets contributed by you regarding this problem. It seemed to be a very frightful crisis for me, but encountering a new well-written tactic you processed it forced me to jump with contentment. Now i am happier for the work and hope you are aware of an amazing job you happen to be getting into educating people through your web blog. Probably you haven’t come across any of us. slot tangandewa
Your article has broadened my understanding and challenged my preconceptions. nhà cái uy tín dev
I appreciate the innovative approach to presenting information here. ยี่ กี ล็ อ ต โต้
thanks for the post. bankruptcy advice near me A criminal lawyer defends individuals and organizations accused of illegal activities, ensuring fair trials and providing legal counsel. They handle cases ranging from minor violations to serious felonies.
dokumencik
Kolekcjonerskie dokumenty z czasów II wojny światowej, w szczególności te pochodzące z pracą Rządu RP na uchodźstwie, reprezentują wyjątkowo istotną część naszego dziedzictwa narodowego. Pośród najbardziej cenionych przez kolekcjonerów są paszporty dyplomatyczne, dowody osobiste oraz prawa jazdy wydawane przez polskie władze emigracyjne. Ten historyczny dokument nie tylko świadczy o trudnych losach Polaków podczas wojny, ale również świadczy ciągłość państwa polskiego w najtragiczniejszych momentach naszej historii.
Fałszywe dokumenty kolekcjonerskie to starannie wykonane kopie prawdziwych dokumentów, produkcjiowane wyłącznie w zamiarze kolekcjonowania. Stanowią atrakcyjnego fragmentu zbiorów dokumentów, a posiadanie takich dokumentów może być legalne, jeżeli są one przechowywane jako kolekcja.
Hakerzy do Wynajęcia
Eksperci od bezpieczeństwa sieciowego to odpowiedź na wyzwania współczesnego świata. Z ich pomocą można ochronić swoje systemy, przywrócić utracone informacje i poznać słabe punkty infrastruktury.
Wynajmowanie specjalistów od sieci podnosi ważne pytania moralne. Prawo dotyczące tych usług zależy od ich celu. Działania mające na celu zabezpieczenie są zazwyczaj zgodne z prawem, działania ofensywne mogą być nielegalne.
Specjalistyczne usługi hakerskie to oferta skierowana do wymagających klientów, która zyskuje na popularności. Współczesny cyfrowy świat wymaga nowoczesnych zabezpieczeń, a profesjonalni hakerzy są w stanie sprostać tym wymaganiom.
Switching to a solar water heater? This website offers all the information you need, from benefits to installation tips. Highly informative! solar water heater
I am thankful for the passion and enthusiasm you bring to your writing. mega wheel
One more great piece! I’m always captivated by your captivating writing style and the wealth of helpful information on your page.lawyer for bankruptcy near meIf you’re looking for a bankruptcy lawyer near you, it’s important to find someone with experience in handling your specific type of bankruptcy, whether it’s Chapter 7, Chapter 13, or another form of debt relief. Local bankruptcy lawyers can provide personalized advice and guide you through the entire process, from filing paperwork to attending court hearings. To find a trusted attorney, you can search online, check local bar association directories, or ask for recommendations. Make sure to choose a lawyer who specializes in bankruptcy law to help you achieve the best possible outcome.
Ich hoffe auch in Zukunft auf denselben großen Einsatz von dir. Tatsächlich haben mich deine kreativen Schreibfähigkeiten inspiriert. wohnungsauflösung in der nähe
da ga 88 – một địa chỉ đáng tin cậy cho những người yêu thích theo dõi các trận đá gà trực tuyến tại Việt Nam, không ngừng cập nhật các liên kết truy cập mới nhất và chính xác nhất để phục vụ cộng đồng.
Looking back at 2020 in Review, iconic moments in pop culture brought us comfort during challenging times. The dumb and dumber lloyd jacket remains a standout piece, symbolizing the humor and nostalgia that kept us smiling. It’s a reminder of how laughter can brighten even the toughest years.
Such sites are important because they provide a large dose of useful information … mangasee
Thank you for the honest and transparent information shared here.หวย ลาว สมัคร
Howdy! Do you know if they make any plugins to safeguard against hackers? I’m kinda paranoid about losing everything I’ve worked hard on. Any recommendations? api294
The MIND Lab at the American University of Beirut has made significant advancements in artificial intelligence, including machine learning theory and applications. They have contributed to AI-driven initiatives like an empathy-driven Arabic conversational chatbot and developed Natural Language Processing models. Their interdisciplinary focus includes climate-adapted buildings and epileptic seizures prediction models.lawyers for contract disputes
abg viral bokep
live bokep viral
viral ngentot abg
I am grateful for the depth of thought and research that went into your article. sòng bạc greendragon
For true fans of this thread I will address is a free online! antonio dilger
I love significantly your own post! I look at all post is great. I discovered your personal content using bing search. Discover my webpage is a great one as you.I work to create several content this post. Once more you can thank you and keep it create! Enjoy! Finance Legend
In the AUB MIND Lab 2020 in Review we saw remarkable advancements in technology and innovation as we reflect on these achievements one area that stood out was the integration of 3D design techniques into various industries Specifically 3d puff embroidery digitizing has gained popularity offering more dynamic and textured designs revolutionizing the way embroidery is approached.
Trusted Dental Services Near Me in El Cajon Near Santee | Invisalign, Dental Implants, TMJ, and Emergency Dentistry Experts. Call 619-440-7000 today! porcelain veneers
Thanks for sharing such great information, I highly appreciate your hard-working skills as the post you published have some great information which is quite beneficial for me, I hope you will post more like that in the future. Thank you for helping people get the information they need. Great stuff as usual. Keep up the great work. VirginiaVADMV
At Whole Melts Extracts, we are passionate about crafting the finest, high-quality extracts to enhance your wellness journey. Rooted in excellence and innovation, our mission is to deliver premium products that uphold the integrity of natural ingredients.
whole melt extracts
cpapLooking for relief from TMJ or Sleep Apnea? Glastonbury’s top-rated clinic offers expert care in TMJ, Facial Pain, and Invisalign. Call 860-430-5687 today! cpap
Your writing style has been amazed me. Thank you, quite great article.lawyer bankruptcies
Your work always inspires. Thank you for this valuable contribution! HMFusaFinance
Achieve a healthy smile with Hillsboro Dental Excellence! Top-rated Invisalign, Sleep Apnea, and Dental Implant services. Call 503-648-6671 today! urgent dental care
Your article is a testament to the depth of your expertise and the breadth of your knowledge. web cờ bạc online
Very interesting blog. Alot of blogs I see these days don’t really provide anything that I’m interested in, but I’m most definately interested in this one. Just thought that I would post and let you know. olympus 1000