PairBench: A Systematic Framework for Selecting Reliable Judge VLMs Permalink
Aarash Feizi, Sai Rajeswar, Adriana Romero-Soriano, Reihaneh Rabbany, Spandana Gella, Valentina Zantedeschi, Joao Monteiro
Aarash Feizi, Sai Rajeswar, Adriana Romero-Soriano, Reihaneh Rabbany, Spandana Gella, Valentina Zantedeschi, Joao Monteiro
Ahmed Masry, Juan A. Rodriguez, Tianyu Zhang, Suyuchen Wang, Chao Wang, Aarash Feizi, Akshay Kalkunte Suresh, Abhay Puri, Xiangru Jian, Pierre-Andr’e Noel, S...
Andreea Musulan, Veronica Xia, Ethan Kosak-Hine, Tom Gibbs, Vidya Sujaya, Reihaneh Rabbany, J. Godbout, Kellin Pelrine
Juan Rodriguez, Xiangru Jian, Siba Smarak Panigrahi, Tianyu Zhang, Aarash Feizi, Abhay Puri, Akshay Kalkunte, Franccois Savard, Ahmed Masry, Shravan Nayak, R...
Bijean Ghafouri, Shahrad Mohammadzadeh, James Zhou, Pratheeksha Nair, Jacob-Junqi Tian, Mayank Goel, Reihaneh Rabbany, J. Godbout, Kellin Pelrine
Data is a barrier to reliable misinformation detection solutions. To address this, we curated the largest collection of (mis)information datasets in the lite...
Rohan Sukumaran, Aarash Feizi, Adriana Romero-Sorian, G. Farnadi Paper Abstrac...
Shahrad Mohammadzadeh, Juan David Guerra, Marco Bonizzato, Reihaneh Rabbany, G. Farnadi Paper ...
In this paper, we present a multi-agent simulator based on Deepmind’s Concordia, a software library for LLM-based multi-agent simulations of real world human...
Tom Gibbs, Ethan Kosak-Hine, George Ingebretsen, Jason Zhang, Julius Broomfield, Sara Pieri, Reihaneh Iranmanesh, Reihaneh Rabbany, Kellin Pelrine
We demonstrated an effective two LLM agent architecture for misinformation detection and fact-checking. It can increase the macro F1 of misinformation detect...
Dillon Bowen, Brendan Murphy, Will Cai, David Khachaturov, A. Gleave, Kellin Pelrine Paper ...
Here we introduce the Unified Temporal Graph (UTG) framework, which integrates snapshot-based and event-based machine learning models for temporal graphs und...
The COVID-19 pandemic sparked rigorous debate about public health measures online, as the timing and extent of interventions unfolded. This project evaluates...
While game companies are addressing the call to reduce toxicity and promote player health, the need to understand toxicity trends across time is important. W...
Tom Tseng, Euan McLean, Kellin Pelrine, T. T. Wang, A. Gleave
TGB 2.0 introduces a novel benchmarking framework for evaluating methods for predicting future links on Temporal Knowledge Graphs (TKGs) and Temporal Heterog...
In this work, we introduce new, more rigorous evaluation procedures for link prediction in dynamic graphs, addressing the challenges and real-world considera...
Kerstin Kläser, Bla.zej Banaszewski, S. Maddrell-Mander, Callum McLean, Luis Müller, Alipanah Parviz, Shenyang Huang, Andrew W. Fitzgibbon
Detecting suspicious ads is challenging due to the sensitive, complex, and unlabeled nature of the data. T-Net addresses this as a weakly supervised graph le...
Here we introduce TGX, a Python package specifically designed for the analysis of temporal networks, addressing a gap in existing software libraries that pri...
Tokiniaina Raharison Ralambomihanta, Shahrad Mohammadzadeh, Mohammad Sami Nur Islam, Wassim Jabbour, Laurence Liang
LLMs struggle with hallucinations and overconfident predictions. Uncertainty quantification can improve their reliability and helpfulness. We proposed an unc...
Tyler Vergho, J. Godbout, Reihaneh Rabbany, Kellin Pelrine
Aarash Feizi, Randall Balestriero, Adriana Romero-Soriano, Reihaneh Rabbany
Yury Orlovskiy, Camille Thibault, Anne Imouza, J. Godbout, Reihaneh Rabbany, Kellin Pelrine
Ruben Weijers, Gabrielle Fidelis de Castilho, J. Godbout, Reihaneh Rabbany, Kellin Pelrine
While LLMs have demonstrated how effective they can be for tasks in the English language, such as detecting social media users’ political ideology, their per...
Kellin Pelrine, Mohammad Taufeeque, Michal Zajkac, Euan McLean, A. Gleave
Farimah Poursafaei, Reihaneh Rabbany
SWEET is a weak supervision pipeline for extracting person names from noisy escort ads, addressing the challenge of limited labeled data. SWEET combines rule...
A simple and scalable model that reliably detects toxic content in real-time for a line of chat by including chat history and metadata. ToxBuster consistentl...
D. Beaini, Shenyang Huang, Joao Alex Cunha, Gabriela Moisescu-Pareja, Oleksandr Dymov, Sam Maddrell-Mander, Callum McLean, Frederik Wenkel, Luis Muller, Jama...
Partisanship has increasingly become a major point of contention in public discourse online, and as a result, researchers have developed a variety of methods...
Hao Yu, Zachary Yang, Kellin Pelrine, J. Godbout, Reihaneh Rabbany
Lekang Jiang, Caiqi Zhang, Farimah Poursafaei, Shenyang Huang
In this paper, we introduce the Temporal Graph Benchmark (TGB), a comprehensive collection of large-scale, diverse datasets designed for the realistic, repro...
Pratheeksha Nair
Kellin Pelrine
We propose focusing on generalization, uncertainty, and how to leverage recent large language models, in order to create more practical tools to evaluate inf...
Zachary Yang, Yasmine Maricar, M. Davari, Nicolas Grenon-Godbout, Reihaneh Rabbany
We introduce a novel spectral method called Scalable Change Point Detection (SCPD) to address the limitations of current solutions in detecting anomalous cha...
Maricarmen Arenas, Pratheeksha Nair, Reihaneh Rabbany, G. Farnadi
Sacha Lévy, Reihaneh Rabbany
Catalina Vajiac, Meng-Chieh Lee, Aayushi Kulshrestha, Sacha Lévy, Namyong Park, Andreas M. Olligschlaeger, Cara Jones, Reihaneh Rabbany, C. Faloutsos
Dominic Masters, Josef Dean, K. Klaser, Zhiyi Li, Sam Maddrell-Mander, Adam Sanders, Hatem Helal, D. Beker, A. Fitzgibbon, Shenyang Huang, Ladislav Rampášek,...
Shenyang Huang, Samy Coulombe, Yasmeen Hitti, Reihaneh Rabbany, Guillaume Rabusseau
Javin Liu, Hao Yu, Vidya Sujaya, Pratheeksha Nair, Kellin Pelrine, Reihaneh Rabbany
Identity biases arise commonly from annotated datasets, can be propagated in language models and can cause further harm to marginal groups. Existing bias ben...
T. T. Wang, A. Gleave, Nora Belrose, Tom Tseng, Joseph Miller, Kellin Pelrine, Michael Dennis, Yawen Duan, V. Pogrebniak, S. Levine, Stuart Russell
Catalina Vajiac, Duen Horng, †. Chau, Andreas M. Olligschlaeger, Pratheeksha Nair, Meng-Chieh Lee, M. Cazzolato, Reihaneh Rabbany, Christos Faloutsos
TrafficVis is an interactive interface for detecting and labeling human trafficking (HT) in clusters of escort ads. Developed with domain experts, it uses ad...
Sacha L’evy, Farimah Poursafaei, Kellin Pelrine, Reihaneh Rabbany
Aarash Feizi, Arantxa Casanova, Adriana Romero-Soriano, Reihaneh Rabbany
In this work, we introduce new, more rigorous evaluation procedures for link prediction in dynamic graphs, addressing the challenges and real-world considera...
A. Vijayan, Arvind Muthukrishnan, Aparna Nair, S. Fathima, Pratheeksha Nair, J. Roshan
Pratheeksha Nair, Yifei Li, Catalina Vajiac, Andreas M. Olligschlaeger, Meng-Chieh Lee, Namyong Park, Duen Horng Chau, C. Faloutsos, Reihaneh Rabbany, Chieh ...
Andreea Musulan
Yifei Li, Pratheeksha Nair, Kellin Pelrine, Reihaneh Rabbany
Here we introduce a robust and effective baseline method for node classification in temporal graphs, serving as a benchmark for evaluating more complex model...
Albert Orozco, Reihaneh Rabbany
Zachary Yang, Anne Imouza, Kellin Pelrine, Sacha Lévy, Jiewen Liu, Gabrielle Desrosiers-Brisebois, J. Godbout, A. Blais, Reihaneh Rabbany
Shenyang Huang, Vincent François-Lavet, Guillaume Rabusseau
Liheng Ma, Reihaneh Rabbany, Adriana Romero-Soriano
While many sophisticated detection models have been proposed in the literature, they were often compared with older NLP baselines such as SVMs, CNNs, and LST...
INFOSHIELD is a scalable, parameter-free, and interpretable tool for detecting near-duplicate document clusters, with applications in human trafficking detec...
L. Rheault, Andreea Musulan
Catalina Vajiac, Andreas M. Olligschlaeger, Yifei Li, Pratheeksha Nair, Meng-Chieh Lee, Namyong Park, Reihaneh Rabbany, Duen Horng Chau, C. Faloutsos
Shenyang Huang, Kuan-Chieh Jackson Wang, Alireza Makhzani
Shenyang Huang, Guillaume Rabusseau, Reihaneh Rabbany
SigTran is an efficient graph-based method for identifying illicit nodes in blockchain networks. SigTran constructs a graph from blockchain transaction recor...
Albert Orozco, Sacha Lévy, Reihaneh Rabbany
Kellin Pelrine, Jacob Danovitch, Albert Orozco Camacho, Reihaneh Rabbany
Abby Leung, Xiaoye Ding, Shenyang Huang, Reihaneh Rabbany
In this paper, we introduce a significant enhancement to the standard SEIR (Susceptible, Exposed, Infectious, Recovered) epidemiological model by integrating...
Kian Ahrabian, Aarash Feizi, Yasmin Salehi, William L. Hamilton, A. Bose
Yue Li, Pratheeksha Nair, Zhi Wen, I. Chafi, A. Okhmatovskaia, G. Powell, Yannan Shen, D. Buckeridge
L. Rheault, Andreea Musulan
Shenyang Huang, Yasmeen Hitti, Guillaume Rabusseau, Reihaneh Rabbany Knowledge Discovery and Data Mining Paper ...
Arnab Kumar Mondal, Pratheeksha Nair, Kaleem Siddiqi
S. Alletto, Shenyang Huang, Vincent François-Lavet, Yohei Nakata, Guillaume Rabusseau
L. Rheault, Andreea Musulan
Sameer Sardaar, B. Qi, Alexandre Dionne‐Laporte, G. Rouleau, Reihaneh Rabbany, Y. Trakadis
Rameshwar Pratap, Anup Anand Deshmukh, Pratheeksha Nair, Anirudh Ravi
Pratheeksha Nair, Zhi Wen
Junhao Wang, Sacha Lévy, Ren Wang, Aayushi Kulshrestha, Guillaume Rabusseau, Reihaneh Rabbany
Junhao Wang, Sacha Lévy, Ren Wang, Aayushi Kulshrestha, Reihaneh Rabbany
Shenyang Huang, Vincent François-Lavet, Guillaume Rabusseau
Junhao Wang, Renhao Wang, Aayushi Kulshrestha, Reihaneh Rabbany
L. Rheault, Erica Rayment, Andreea Musulan
Rameshwar Pratap, Anup Anand Deshmukh, Pratheeksha Nair, T. Dutt
Anup Anand Deshmukh, Pratheeksha Nair, Shrisha Rao
D. Eswaran, Reihaneh Rabbany, A. Dubrawski, C. Faloutsos
Reihaneh Rabbany, David Bayani, A. Dubrawski
Justin Fagnan, Afra Abnar, Reihaneh Rabbany, Osmar R Zaiane
Kellin Pelrine
Reihaneh Rabbany, D. Eswaran, Artur W. Dubrawski, Christos Faloutsos
Reihaneh Rabbany, D. Eswaran, A. Dubrawski, C. Faloutsos
Reihaneh Rabbany, Osmar R Zaiane
Reihaneh Rabbany, D. Eswaran, C. Faloutsos, A. Dubrawski
Reihaneh Rabbany, Osmar R Zaiane
Reihaneh Rabbany, Osmar R Zaiane
C. Largeron, Pierre-Nicolas Mougel, Reihaneh Rabbany, Osmar R Zaiane
Justin Fagnan, Reihaneh Rabbany, M. Takaffoli, Eric Verbeek, Osmar R Zaiane
Reihaneh Rabbany, Osmar R Zaiane
M. Takaffoli, Reihaneh Rabbany, Osmar R Zaiane
Afra Abnar, M. Takaffoli, Reihaneh Rabbany, Osmar R Zaiane
Siamak Ravanbakhsh, Reihaneh Rabbany, R. Greiner
Reihaneh Rabbany, Osmar R Zaiane, Samira ElAtia
Reihaneh Rabbany, Samira ElAtia, M. Takaffoli, Osmar R Zaiane
Reihaneh Rabbany, M. Takaffoli, Justin Fagnan, Osmar R Zaiane, R. Campello
M. Takaffoli, Reihaneh Rabbany, Osmar R Zaiane
Reihaneh Rabbany, Mansoreh Takaffoli, Justin Fagnan, Osmar R. Zäıane, R. Campello
Reihaneh Rabbany, M. Takaffoli, Justin Fagnan, Osmar R Zaiane, R. Campello
Reihaneh Rabbany, M. Takaffoli, Osmar R Zaiane
Reihaneh Rabbany, Osmar R Zaiane
Reihaneh Rabbany, Eleni Stroulia, Osmar R Zaiane
Reihaneh Rabbany, M. Takaffoli, Osmar R Zaiane
Jiyang Chen, Justin Fagnan, R. Goebel, Reihaneh Rabbany, Farzad Sangi, M. Takaffoli, Eric Verbeek, Osmar R Zaiane
Course codes: COMP 551 (Winter 2025) Instructors: Reihaneh Rabbany Location: Stewart Biology Building S1/4 (lectures will be recorded) Time: Tuesday...
Course codes: COMP 599 (Fall 2024) Instructors: Reihaneh Rabbany
Course codes: COMP 551 (Winter 2025) Instructors: Reihaneh Rabbany, Isabeau Prémont-Schwarz Location: McConnell 204 Time: Mondays and Wednesdays, 14...
Course codes: COMP 551 (Winter 2023) Instructors: Reihaneh Rabbany Location: Stewart Biology Building S1/4 (lectures will be recorded) Time: Tuesday...
Course codes: COMP 599 (Fall 2022) Instructors: Reihaneh Rabbany Classroom: Rutherford Physics Building 114 Time: Tuesdays and Thursdays, 10:05 am -...
Course codes: COMP 551 (Winter 2022) Instructors: Reihaneh Rabbany Location: Remote (lectures will be recorded) Time: Tuesdays and Thursdays, 1:00 p...
Course codes: COMP 599 (Fall 2021) Instructors: Reihaneh Rabbany Classroom: Macdonald Engineering Building 276 [remote participation through zoom in M...
Course codes: COMP 551 (Winter 2021) Instructors: Reihaneh Rabbany Location: Remote through MyCourse Course Website: here
Course codes: COMP 596 (Fall 2020) Instructors: Reihaneh Rabbany Location: Remote through MyCourses Time: Monday & Wednesday, 10:00 am – 11:30 p...
Course codes: COMP 551 (Winter 2020) Instructors: Reihaneh Rabbany Classroom: Strathcona Anatomy & Dentistry M-1 Time: Tuesdays and Thursdays, 1...
Course codes: COMP 596 (Fall 2019) Instructors: Reihaneh Rabbany Classroom: ENGMC 103 Time: Tuesdays and Thursdays, 10:00 am – 11:30 pm Course Web...
In this work, we introduce new, more rigorous evaluation procedures for link prediction in dynamic graphs, addressing the challenges and real-world considera...
We introduce a novel spectral method called Scalable Change Point Detection (SCPD) to address the limitations of current solutions in detecting anomalous cha...
Here we introduce a robust and effective baseline method for node classification in temporal graphs, serving as a benchmark for evaluating more complex model...
SigTran is an efficient graph-based method for identifying illicit nodes in blockchain networks. SigTran constructs a graph from blockchain transaction recor...
In this paper, we introduce a significant enhancement to the standard SEIR (Susceptible, Exposed, Infectious, Recovered) epidemiological model by integrating...
Data is a barrier to reliable misinformation detection solutions. To address this, we curated the largest collection of (mis)information datasets in the lite...
We demonstrated an effective two LLM agent architecture for misinformation detection and fact-checking. It can increase the macro F1 of misinformation detect...
LLMs struggle with hallucinations and overconfident predictions. Uncertainty quantification can improve their reliability and helpfulness. We proposed an unc...
We propose focusing on generalization, uncertainty, and how to leverage recent large language models, in order to create more practical tools to evaluate inf...
While many sophisticated detection models have been proposed in the literature, they were often compared with older NLP baselines such as SVMs, CNNs, and LST...
Here we introduce the Unified Temporal Graph (UTG) framework, which integrates snapshot-based and event-based machine learning models for temporal graphs und...
TGB 2.0 introduces a novel benchmarking framework for evaluating methods for predicting future links on Temporal Knowledge Graphs (TKGs) and Temporal Heterog...
Here we introduce TGX, a Python package specifically designed for the analysis of temporal networks, addressing a gap in existing software libraries that pri...
In this paper, we introduce the Temporal Graph Benchmark (TGB), a comprehensive collection of large-scale, diverse datasets designed for the realistic, repro...
In this work, we introduce new, more rigorous evaluation procedures for link prediction in dynamic graphs, addressing the challenges and real-world considera...
Detecting suspicious ads is challenging due to the sensitive, complex, and unlabeled nature of the data. T-Net addresses this as a weakly supervised graph le...
SWEET is a weak supervision pipeline for extracting person names from noisy escort ads, addressing the challenge of limited labeled data. SWEET combines rule...
TrafficVis is an interactive interface for detecting and labeling human trafficking (HT) in clusters of escort ads. Developed with domain experts, it uses ad...
INFOSHIELD is a scalable, parameter-free, and interpretable tool for detecting near-duplicate document clusters, with applications in human trafficking detec...
While game companies are addressing the call to reduce toxicity and promote player health, the need to understand toxicity trends across time is important. W...
A simple and scalable model that reliably detects toxic content in real-time for a line of chat by including chat history and metadata. ToxBuster consistentl...
Identity biases arise commonly from annotated datasets, can be propagated in language models and can cause further harm to marginal groups. Existing bias ben...
The COVID-19 pandemic sparked rigorous debate about public health measures online, as the timing and extent of interventions unfolded. This project evaluates...
While LLMs have demonstrated how effective they can be for tasks in the English language, such as detecting social media users’ political ideology, their per...
Partisanship has increasingly become a major point of contention in public discourse online, and as a result, researchers have developed a variety of methods...
social-simulations
A Simulation System Towards Solving Societal-Scale Manipulation Permalink
In this paper, we present a multi-agent simulator based on Deepmind’s Concordia, a software library for LLM-based multi-agent simulations of real world human...