The 3rd Workshop on Data Science with Human in the Loop @ KDD 2021

Call for Papers


We invite submissions describing innovations and implementations that focus on understanding how to optimize human-computer cooperation and minimize human effort along the data science pipeline in a wide range of data science tasks and real-world applications.

Topics of interest to this workshop include, but are not limited to:

  • Supervised learning with human-in-the-loop

  • Human intervention in unsupervised learning

  • Human intervention and unintended model bias and overfitting

  • Human-assisted knowledge extraction

  • Expert-guided knowledge injection in modeling

  • Human and computer cooperation in data cleaning, preparation, representation

  • Optimizing human effort in data annotation and labeling

  • Human feedback in error analysis and model improvement

  • Enabling non-machine learning experts to build data science models

  • Formal and higher abstractions for human-machine interaction in data science

  • User interfaces for data cleaning, processing, annotation, and labeling

  • User interfaces that facilitate building data science models

  • Human-in-the-loop issues in mining of text data, image and video data, social media data, graph data, sequential data

  • Human-in-the-loop issues in building data science models in scientific, business, and engineering domains


Authors are invited to submit either of the following:

  • Original, unpublished research papers that are not being considered for publication in any other forum. Research papers are limited to six pages in length, excluding references.

  • Short papers of late-breaking work and work in progress. Abstracts are limited to two pages.

Authors of both types of papers will need to present these papers at DaSH.

Submissions to the workshop must be in PDF and should follow the KDD paper formatting. All submissions should be anonymized to facilitate double blind reviewing. To submit a paper, please access the submission link:

Important Dates

Submission deadline20 May 2021 1 June 2021

Notification 10 June 2021 22 June 2021

Camera ready 20 June 2021 30 June 2021

Workshop Dates 14-18 August 2021

All deadlines are 11.59pm UTC -12h


  • Presentation format and schedule will be announced before the camera-ready deadline.