The Machine INtelligence Development (MIND) Lab at the American University of Beirut (AUB) aims at providing state of the art solutions in the field of Artificial Intelligence with a focus on machine learning theory and applications. The lab has recently established a new identity, grew in size, and saw great progress in cutting-edge research in two main domains: Natural Language Processing and Context-Aware Sensing.
As we begin a new year, we are extremely proud of the diligence and perseverance that our lab has shown despite the challenges that oversaw the world and Lebanon the past year. Our students were able to push cutting-edge research, produce publications, compete in local and global challenges, and share their expertise with the world through open-source solutions and invited talks.
2020 Research Manifesto
Natural Language Processing (NLP)
Our NLP focused team has explored a wide range of challenges, from conversational systems and Arabic as a low-resource language to studying human reading comprehension.
Gilbert Badaro, our lab’s newest Ph.D. graduate, has investigated multiple link prediction approaches and different natural language processing variations in order to try to link a large lexical Arabic Resource, SAMA, to English WordNet. In his work, he used a machine learning approach and developed training data using existing small-scale Arabic WordNet. His latest article is important because it provides publicly a large-scale sentiment lexical resource for Arabic, ArSenL 2.0, to enable more accurate sentiment mining models. It also presents a benchmark dataset to be used by other researchers in the field interested in automatically evaluating approaches for Arabic WordNet expansion.
Obeida ElJundi has focused on exploring human reading comprehension. Reading comprehension is not the result of one single process as was thought before the 1970s. Rather, psychologists realized that a combination of several complex cognitive processes is involved. Traditional NLP algorithms used nowadays (e.g., RNN) cover some aspects of the reading comprehension cognitive processes, such as attention and forgetting, but render other aspects unaccounted for. Obeida has been looking into studying how the human brain reads and comprehends written text will help reveal what is missing and improve the overall performance of NLP.
Wissam Antoun has recently defended his thesis on Arabic Transformers for NLU and chatbots. This year, he trained the first Arabic BERT model, AraBERT, alongside his colleague, Fady Baly. Wissam is now planning to explore newer and better models for language understanding and generation, and he is off to a great start! Wissam and Fady have started 2021 by releasing 10 new Arabic Transformer Models (AraGPT2, AraELECTRA & AraBERTv2) on AUB Mind Lab and Hugging Face Github repositories.
Nataly Dalal has worked on designing lifelong learning for chatbots in customer support, thus allowing them to continuously learn and accumulate knowledge on their own from support forums posted on the web. Lifelong learning aims at producing chatbots that are more accurate, robust, and human-like.
Christian Hokayem has focused the bulk of his research on conversational automated negotiation agents. With the goal of improving user experience in an automated sales setting, he investigated what empathy is and tried to find a way to incorporate it into agents’ language generation and decision-making models. In his work, he formulated the problem as a multi-objective reinforcement learning problem and taught the bot to maximize user experience (represented by sentiment) and sales price.
Tarek Naous, our newest master’s student, has started with research focused on enabling empathetic behavior in conversational agents for the Arabic Language with the global aim of making human-machine interactions more similar to human-human interactions. In 2020, he was able to release a dataset of empathetic conversations in Arabic and propose a neural-based model for generating empathetic responses. His work was published in WANLP 2020 and is currently in progress for further development, where the challenge is improving performance given the limited dataset size we have.
Context-Aware Sensing
With a focus on overcoming the challenge of learning from limited labeled data, our work in context-aware sensing has been versatile, ranging from applications of healthcare, such as traumatic brain injuries and epilepsy prediction, to power load forecasting and human activity recognition.
Reem Mahmoud’s research interest is in personalized Machine Learning, which branches into problems of learning with little labeled data and advancing traditional transfer learning methods. This past year, she has looked into overcoming challenges of catastrophic forgetting in pre-trained neural networks on time-series applications, such as human activity recognition. Her work looked into improving performance on target tasks with limited training data while preserving performance on source tasks from the pre-trained model. This work, titled “Multi-Objective Learning to Overcome Catastrophic Forgetting in Time-series Applications,” has been recently submitted to the journal of ACM Transactions on Knowledge Discovery from Data.
Marc Djandji has focused his research for the past year on improving the performance of deep learning models when trained with limited labeled training examples. He has specifically investigated the problem under the application of short-term load forecasting. His work looks into scalable multi-task learning methods.
This year, Alaa Khaddaj had completed an internship at Signal Kinetics (MIT Media Lab) under the supervision of Prof. Fadel Adib, where they developed an apparatus that can detect contaminated food or counterfeit products. The system used a generative model (variational autoencoder) to generalize to new unseen environments and a transfer learning scheme to learn from multiple experiments simultaneously. Alaa’s other line of research was to develop a domain adaptation model that can generalize a classifier between two similar domains that have some differences. For his final year project, his team developed an intelligent question-answering system for customer support. This work has been submitted as a journal paper.
Mosbah Aouad has worked on developing deep learning models for short-term load forecasting for residential houses, where the challenge is to deal with the high non-linearities present in the load data. To build a sensitive model to varying load patterns and large peaks in the data, he designed an attention mechanism to augment a sequence-to-sequence network to capture these variations. On the other side, his thesis work has focused on biomedical image analysis with the aim of predicting the survival rate of penetrating traumatic brain injury (pTBI) patients from brain CT scans analysis. He is designing a representation learning approach that captures relevant features reflecting the severity of pTBIs from CT scan analysis directly.
Open-source Solutions, Competitions & Other Activities
Beyond the efforts in research, we are proud of the efforts our team has put into sharing and pushing their expertise through participating in competitions, open-sourcing solutions, and delivering talks.
Here are some of our highlights from 2020:
-
- We launched our AUB MIND Lab’s Github Repository and a brand new website for the group.
- Amir Hussein, Rim Achour, and Fady Baly ranked 1st place at QICC Cybersecurity contest in Fake News Detection task.
- Alaa Khaddaj won Best Paper Award at IEEE ICIoT 2020.
- Obeida ElJundi and his work on hULMonA were featured in WIRED Middle East
- AraBERT by our alumnus, Wissam Antoun, and Fady Baly has been featured in MIT Technology Review Arabia
- Marc Djandji, Fady Baly, and Wissam Antoun ranked 2nd Place at 4th Workshop on Open-Source Arabic Corpora and Processing Tools (OSACT 4) in Hate and Offensive speech detection tasks – Marseille, France 2020
- Wissam Antoun invited by IWAN Research Group at King Saud University to deliver a talk titled “AraBERT: Pretraining, fine-tuning, applications and demo (In Arabic),” September 2020.
- Wissam Antoun invited by PyData Khobar Meetup to deliver a talk titled “AraBERT: Pretraining, use cases and future improvements,” May 2020.
2020 Graduates
-
- Dalia Jaber – M.E. in Electrical & Computer Engineering
- Wissam Antoun – M.E. in Electrical & Computer Engineering
- Amir Hussein – M.E. in Electrical & Computer Engineering
- Alaa Khaddaj – B.E. in Electrical & Computer Engineering
- Gilbert Badaro – Ph.D. in Electrical & Computer Engineering
- Raslan Kain – M.E. in Electrical & Computer Engineering
2020 List of Publications
Journal Papers
-
- R. Mahmoud, H. Hajj, F. Karameh, “A Systematic Approach to Multi-Task Learning from Time-series Data” Elsevier Applied Soft Computing, Vol. 96 (2020), 106586.
- G. Badaro, H. Hajj, N. Habash, “A Link Prediction Approach for Accurately Mapping a Large-Scale Arabic Lexical Resource to English WordNet,” ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP), 19, no. 6 (2020): 1-38.
- N. Abbas, S. Sharafeddine, H. Hajj, and Z. Dawy, “Price-Aware Traffic Splitting in D2D HetNets with Cost-Energy-QoE Tradeoffs,” Computer Networks, vol. 172, p. 107169, 2020.
- A. Hussein, M. Djandji, R. Mahmoud, M. Dhabi, H. Hajj, “Augmenting Deep Learning with Adversarial Training for Robust Prediction of Epilepsy Seizures” ACM Transactions on Computing for Healthcare, June 2020, Article 18.
- S. Taleb, A. Yeretzian, R. A. Jabr, and H. Hajj. “Optimization of building form to reduce incident solar radiation.” Journal of Building Engineering 28 (2020): 101025.
Conference Papers
-
- W. Antoun, F. Baly, H. Hajj, “AraBERT: Transformer-based Model for Arabic Language Understanding.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 9-15. 2020.
- T. Naous, C. Hokayem, H. Hajj, “Empathy-driven Arabic Conversational Chatbot,” Proceedings of the Fifth Arabic Natural Language Processing Workshop, December 2020, Barcelona, Spain (Online), pp 5-68.
- S. Taleb, A. Yeretzian, R. Jabr, H. Hajj, “Energy Optimization of Climate Adapted Buildings in an Urban Context: The Case of Subtropical Climate”, 35th PLEA Conference: Planning Post Carbon Cities, 1-3 September 2020 A Coruña, Spain.
- M. Djandji, F. Baly, W. Antoun, H. Hajj. “Multi-Task Learning using AraBert for Offensive Language Detection.” In Proceedings of the 4th Workshop on Open-Source Arabic Corpora and Processing Tools, with a Shared Task on Offensive Language Detection, pp. 97-101. 2020.
- O. ElJundi, M. Dhaybi, K. Mokadam, H. Hajj, and D. Asmar, “Resources and End-to-End Neural Network Models for Arabic Image Captioning,” In Proceedings of the 15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications – Volume 5: VISAPP, 233-241, 2020, Valletta, Malta.
- A. Khaddaj, H. Hajj, “Representation Learning for Adversarial Domain Adaptation in Text Classification,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020. [Winner of best paper award]
- A. Maarouf, N. El Droubi, R. Morcel, H. Hajj, M. Saghir, and H. Akkary. “Optimized Distribution of an Accelerated Convolutional Neural Network across Multiple FPGAs.” In 2020 IEEE 28th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM), pp. 235-235. IEEE, 2020.
- W. Antoun, F. Baly, R. Achour, A. Hussein, H. Hajj, “State of the Art Models for Fake News Detection Tasks,” In Proceedings of the IEEE International Conference on Informatics, IoT, and Enabling Technologies (ICIoT’20), Qatar, Feb 2-5, 2020.
To discover our lab and potential opportunities, visit our site or stay up to date with our news on LinkedIn and Twitter.
I wish more writers of this sort of substance would take the time you did to explore and compose so well. I am exceptionally awed with your vision and knowledge. Aquapura.be
I can set up my new idea from this post. It gives in depth information. Thanks for this valuable information for all,.. Zonnepanelenantwerpen.be
Truly, this article is really one of the very best in the history of articles. I am a antique ’Article’ collector and I sometimes read some new articles if I find them interesting. And I found this one pretty fascinating and it should go into my collection. Very good work! Thuisbatterijenprijs.be
This was among the best posts and episode from your team it let me learn many new things. Zonnepanelen-centrale.be
I love the way you write and share your niche! Very interesting and different! Keep it coming! Zonnepanelenmetbatterijen.be
Good to become visiting your weblog again, it has been months for me. Nicely this article that i’ve been waited for so long. I will need this post to total my assignment in the college, and it has exact same topic together with your write-up. Thanks, good share. Zonnepaneleninlimburg.be
Actually I read it yesterday but I had some thoughts about it and today I wanted to read it again because it is very well written. Crepi-gevelbekleding.be
Just saying thanks will not just be sufficient, for the fantasti c lucidity in your writing. I will instantly grab your rss feed to stay informed of any updates. Crepigevels.be
I will be interested in more similar topics. i see you got really very useful topics , i will be always checking your blog thanks Crepigevelbepleistering.be
Really appreciate this wonderful post that you have provided for us.Great site and a great topic as well i really get amazed to read this. Its really good. Zwembaden-lebaindor.be
I will really appreciate the writer’s choice for choosing this excellent article appropriate to my matter.Here is deep description about the article matter which helped me more. Iso-flex.be
The way you articulate your ideas demonstrates a deep understanding of the subject matter. no hu
The design confidently amazing. These little information are generally fabricated applying massive amount record expertise. ฟิล์ม AutoShield
I just stumbled upon your blog and wanted to say that I have truly loved browsing your blog posts. I hope you write again very soon! Feel free to visit my website. ติดต่อหวยลาวพัฒนา
AUB MIND Lab’s 2020 in Review highlights key achievements in research and innovation. For enhanced gaming experiences, download Bloxstrap R63, an efficient Roblox launcher that streamlines account management and gameplay.https://getbloxstrap.app/download/
The 2020 in Review from AUB MIND Lab demonstrates significant advancements in both research and innovation. Get the effective Roblox launcher Bloxstrap R63, which simplifies account management and gameplay, for better gaming experiences. I am very grateful that you shared this fantastic content with us. fraud lawyer A fraud lawyer defends clients charged with various crimes, including wire fraud, mail fraud, securities fraud, healthcare fraud, tax fraud, and identity theft, which can be complex and heard in federal or state courts.
Baddiehubtimes is a platform that offers an exclusive collection of curated content, including photos, videos, and articles tailored to individuals interested in lifestyle, beauty, and social trends. baddiehubtimes
Trendufeed is a content platform dedicated to delivering the latest trending news, updates, and viral stories. It consolidates information from various fields, making it accessible and convenient for users who want to stay informed. Health and Wellness Tips
Trendufeed is a content platform dedicated to delivering the latest trending news, updates, and viral stories. It consolidates information from various fields, making it accessible and convenient for users who want to stay informed. Current Affairs
I would like to read more of your articles. Because it’s so amazing. หวย ฮ่องกง วันนี้
great work… Excellent weblog here! Also your web site a lot up fast! What web host are you the usage of? Can I get your associate link on your host? I want my website loaded up as fast as yours lol… slot online
Your unique perspective adds depth and richness to the discourse surrounding [topic of the article].
ลิงค์เข้าหวยเกาหลี
I am grateful for the impact your work has had on me. nỗ hu
I appreciate you shedding light on this JóvenesenAcción
I truly like you’re composing style, incredible data, thankyou for posting. sbobet
I am overpowered by your post with such a decent theme.
123betting
thanks for the well explained post. best lawyer for reckless driving in virginia For specialized guidance and resources in this area, speak with an experienced lawyer. You are also welcome to ask any questions you may have.
joyfball
Your article has opened my eyes to new possibilities and perspectives. kiếm tiền online
This is very educational content and written well for a change. It’s nice to see that some people still understand how to write a quality post! togel online
I am grateful for the depth of thought and research that went into your article.หวยบี
bermain slot online bersama Yeti878 dengan pola-pola jitu dari slot thailand yang memberikan kemenangan terbesar bagi para pemain
if you find the good blog this is it Slot Qris
ClickSud- Lumea ta Digitală
În era digitală în care trăim, Clicksud se dovedește a fi un ghid esențial pentru utilizatorii români care doresc să navigheze cu succes prin vasta lume a tehnologiei și internetului. Acest site nu doar că oferă informații utile, dar creează și o comunitate activă de pasionați de tehnologie.
Ce este Clicksud?
Clicksud este o platformă dedicată celor care doresc să învețe mai multe despre diverse aspecte ale vieții digitale. De la recenzii de produse tech, la sfaturi despre utilizarea eficientă a aplicațiilor, Clicksud acoperă o gamă largă de subiecte. Scopul său este de a face tehnologia accesibilă tuturor, indiferent de nivelul de cunoștințe.
Resurse Utile
Una dintre caracteristicile cheie ale Clicksud este varietatea de resurse disponibile. Utilizatorii pot găsi articole despre:
Recenzii de gadgeturi: Informații detaliate despre cele mai noi produse electronice de pe piață.
Tutoriale: Ghiduri pas cu pas pentru a utiliza aplicații populare și instrumente digitale.
Știri IT: Actualizări despre cele mai recente inovații și tendințe în tehnologie.
Comunitatea Clicksud
Clicksud nu este doar un simplu site de informații; este și o comunitate. Utilizatorii pot interacționa prin comentarii, pot pune întrebări și pot împărtăși propriile experiențe. Această interacțiune face ca informațiile să fie nu doar utile, ci și personalizate, bazate pe nevoile și curiozitățile comunității.
Concluzie
În concluzie, Clicksud – Lumea ta Digitală este mai mult decât o resursă informativă; este un punct de plecare pentru oricine dorește să se familiarizeze cu tehnologia modernă. Fie că ești un novice în domeniu sau un expert, Clicksud îți oferă instrumentele necesare pentru a naviga cu încredere în lumea digitală.
OFFICAL WEBSITE : https://ClickSud.gay/
Sweet blog! I found it while searching on Yahoo News. Do you have any tips on how to get listed in Yahoo News? I’ve been trying for a while but I never seem to get there! Thanks Crypto30x
Our dedicated customer service team is available 24/7 to assist you. Whether you have questions or encounter issues, our professionals are here to provide the best solutions. Super4dtoto wap login
I really loved reading your blog. It was very well authored and easy to undertand. Unlike additional blogs I have read which are really not tht good. I also found your posts very interesting. In fact after reading, I had to go show it to my friend and he ejoyed it as well! milan69 link
This is very educational content and written well for a change. It’s nice to see that some people still understand how to write a quality post! Bandar slot gacor
I wish to express my respect for your generosity supporting men and women who require guidance on this one topic. Your special commitment to getting the solution all-around has been especially important and have all the time made those much like me to attain their objectives. Your amazing important recommendations implies much a person like me and a whole lot more to my office workers. Best wishes; from each one of us. slot
I’m really impressed with the speed and efficiency of the website. No delays. playing whit the best website Pikbet88 is the best gamling website
This is a great resource for learning! Thank you for putting this together. Pikbet88 I love how easy-to-understand the explanations are. Very helpful!
very nice, Thanks for sharing the most important information I am so glad to visit this blog. ทางเข้า 123vip
I have been reading out many of your articles and i can claim pretty nice stuff. I will make sure to bookmark your blog. Crypto30x
Exploring 8.44114-0.67082 Dive into a comprehensive guide to the latest data analysis tools and techniques. Learn how to uncover trends, make informed decisions, and maximize the value of your data with user-friendly platforms and advanced strategies.
voiranime, anime, scan, anime sama, vostfr, vf, streaming, streaming vostfr, streaming vf, sans pubs, streaming sans pubs, streaming scan. voiranime
logo:aywunaumjsq=fortnite Unlock your creative potential with expert graphic design tips and tools. Whether you’re a beginner or a seasoned designer, this guide covers everything from fundamental design principles to the latest software that can elevate your work.
Excellent post! We will be linking to this particularly great post on our site. 123bet กีฬา Keep up the great writing.
Thank you for your tireless pursuit of excellence in your writing. nỗ hũ
I had a great time reading your blog. It was easy to understand and really well written. in contrast to other blogs I’ve read, which aren’t that good. Your posts piqued my interest as well. Actually, after reading. Fairfax Expungement Lawyer An expungement attorney in Fairfax, Virginia focuses on assisting people in getting their criminal records expunged, which can be essential for enhancing one’s chances of finding employment, finding housing, and generally living a better life. It is crucial to work with an attorney that specializes in Virginia expungement law because state-by-state regulations differ and Virginia has unique eligibility requirements.
I am really happy to read this article of yours, what you compiled is so detailed. คาสิโนมือถือ Thanks for sharing it!