One cough at a time

There is research that shows that a cough contains a lot of information. We wanted to prove that this cough has indicators that would help us screen COVID-19 patients.
To the best of our knowledge, we have collected the largest cough sample dataset for COVID-19.

There is research that shows that a cough contains a lot of information. We wanted to prove that this cough has indicators that would help us screen COVID-19 patients. And we did. I urge you to read our blog that explains how Cough against COVID can increase testing by 43% while keeping the number of lab-based tests constant. 

To achieve this, the research team had asked us for a wide range of coughs, a dataset, which represents the width of India. To the best of our knowledge, we have collected the largest cough sample dataset for COVID-19. The dataset comprises 40,000 sounds from more than 7,000 individuals. We were happy, mind you. But now that the dust has settled on our five-month-long sprint, it isn’t the size of the dataset but the processes that we put in place, the best practices we followed, and the support we got from our partners through the process that gives us pride. 

Let’s take you back a few months when we decided to start facility-based data collection. There were ground realities we had to consider before we chose our facilities. At the time, the virus was locked in the big metros such as Mumbai and Delhi. It was rearing its head in states like Tamil Nadu as well. There were cases outside these places but the healthcare systems did not seem to be overwhelmed. Our first pick to set up our cough collection facility was in Bihar. There were two reasons we chose this site. 

  1. Disease prevalence. We wanted to go to a low disease prevalence area. When the healthcare systems are overwhelmed, hospital administrators and doctors have different priorities. 
  2. We found the right partners in the Norway India Partnership Initiative (NIPI) and Doctors for You (DFY). We have been working with NIPI on another project and the partnership, in this case, seemed organic.

Since India was under lockdown, our program team couldn’t travel to set up processes and do in-person meetings. We leaned on partners such as DFY, who had feet on the ground, to help us get institutional ethics committee approval and on-board field staff to carry out research. NIPI, due to its unique nature, helped us get statewide administrative approval quickly. They facilitated one-on-one meetings with the senior-most public health officials so we could explain our research to them. Once we got the go-ahead to collect cough samples, we initiated activities at SK Medical College, Muzaffarpur and Nalanda Medical College, Patna. Now was the time to set up our processes, which would collect high-quality data and protect our on-ground research coordinators. It was an iterative process but we finally came up with standard operating procedures. 


1. The patient walks through the door and is screened by the hospital staff. If she is determined to be eligible for the RT-PCR test, she is informed of our research. On receiving consent, she is led to a recording room. All her demographic and contextual information is recorded on an app. Let’s call it app #1.

2. In the recording room, a PPE-clad research assistant records cough and speech samples on a smartphone. These samples are recorded on another app. Let’s call it app #2. This smartphone doesn’t leave this room.

3. The patient is then led to another chamber for a lab-based test. Once the results of the lab test of the patient are generated, they are recorded in app #3. The information in all three apps is now merged to get one full dataset.

This SOP helped us formalise a process, which was replicated (with small contextual variations) in Odisha, Rajasthan, and Maharashtra.

We picked each of these states for various reasons and, honestly we were not shy of being opportunistic either. We wanted to conduct our research at scale and at pace. For example, in Mumbai, once we got regulatory approvals, we partnered with Doctors For You, which mobilised healthcare workers during times of crisis. Their ground staff started assisting us in collecting data. We also partnered with Radical Health, a technology firm working with MCGM for comorbidity screening of high-risk individuals. 

In Rajasthan, we partnered with AIIMS Jodhpur because it is a unique hospital. In the early days of the pandemic, Indians returning from overseas, with possible COVID-19 exposure, were being treated there. It gave us a large collection of patients at a single location. Partnership with NIPI opened up all major testing sites in the state of Odisha.

This gave us a wide variety of sounds from different corners of India. 

While data collection procedures were in place, we also had to set up research coordinator procedures. The first step was to hire the right people. For us, step one was to find candidates who lived in the same city, had worked in hospital settings and had participated in data collection studies. It was a niche demand. But we found them. Once they were introduced to our data collection SOP, we had to create systems which would help them stay healthy.

Since we couldn’t send them back home, we found hotels, hostels and apartments where these volunteers could be housed. We spoke to the hospitals so that they were treated as staff and allowed to access hospital canteens. We made sure they had adequate protective gear such as masks and PPE. We even taught them how to wear, remove and dispose of these masks.

Amidst lockdown, we organised the entire supply chain to provide necessary logistics to them. In situations where we couldn’t, our partners helped us provide them with kits from the hospital. Along with the prevalent infection prevention guidelines, we recognised that prolonged exposure to the COVID-19 patients may put them in danger of infection, so we put in place short six-hour shifts. In some locations, we would ask them to work in two-week sprints. So essentially, they would work for two weeks and have a cooling-off period of two weeks. We bought our coordinators insurance, both health and term, in case the dangers of the job got to them. At the peak of our exercise, we had 20+ dedicated coordinators apart from the active on-field staff of the partner organisations. 

They are the real heroes. Recording coughs, talking to people and giving us feedback on how the app was functioning. Their feedback helped us simplify the app and sharpen our processes to a level that it could be explained in a short demonstration session to any new coordinators who joined the team. 

Essentially, what we did can now be replicated by anyone across the world. My only advise: find the right partners. We were lucky enough to find the right ones who would help us fill in the gaps when needed. 

I still remember our first week with great pride especially, on the very first day, when we had data from 20 patients recorded in a single day, We knew back then that we were building our dataset. One cough at a time.

  • Wadhwani AI

    We are an independent and nonprofit institute developing multiple AI-based solutions in healthcare and agriculture, to bring about sustainable social impact at scale through the use of artificial intelligence.

ML Engineer

ROLES AND RESPONSIBILITIES

An ML Engineer at Wadhwani AI will be responsible for building robust machine learning solutions to problems of societal importance; usually under the guidance of senior ML scientists, and in collaboration with dedicated software engineers. To our partners, a Wadhwani AI solution is generally a decision making tool that requires some piece of data to engage. It will be your responsibility to ensure that the information provided using that piece of data is sound. This not only requires robust learned models, but pipelines over which those models can be built, tweaked, tested, and monitored. The following subsections provide details from the perspective of solution design:

Early stage of proof of concept (PoC)

  • Setup and structure code bases that support an interactive ML experimentation process, as well as quick initial deployments
  • Develop and maintain toolsets and processes for ensuring the reproducibility of results
  • Code reviews with other technical team members at various stages of the PoC
  • Develop, extend, adopt a reliable, colab-like environment for ML

Late PoC

This is early to mid-stage of AI product development

  • Develop ETL pipelines. These can also be shared and/or owned by data engineers
  • Setup and maintain feature stores, databases, and data catalogs. Ensuring data veracity and lineage of on-demand pulls
  • Develop and support model health metrics

Post PoC

Responsibilities during production deployment

  • Develop and support A/B testing. Setup continuous integration and development (CI/CD) processes and pipelines for models
  • Develop and support continuous model monitoring
  • Define and publish service-level agreements (SLAs) for model serving. Such agreements include model latency, throughput, and reliability
  • L1/L2/L3 support for model debugging
  • Develop and support model serving environments
  • Model compression and distillation

We realize this list is broad and extensive. While the ideal candidate has some exposure to each of these topics, we also envision great candidates being experts at some subset. If either of those cases happens to be you, please apply.

DESIRED QUALIFICATIONS

Master’s degree or above in a STEM field. Several years of experience getting their hands dirty applying their craft.

Programming

  • Expert level Python programmer
  • Hands-on experience with Python libraries
    • Popular neural network libraries
    • Popular data science libraries (Pandas, numpy)
  • Knowledge of systems-level programming. Under the hood knowledge of C or C++
  • Experience and knowledge of various tools that fit into the model building pipeline. There are several – you should be able to speak to the pluses and minuses of a variety of tools given some challenge within the ML development pipeline
  • Database concepts; SQL
  • Experience with cloud platforms is a plus
mle

ML Scientist

ROLES AND RESPONSIBILITIES

As an ML Scientist at Wadhwani AI, you will be responsible for building robust machine learning solutions to problems of societal importance, usually under the guidance of senior ML scientists. You will participate in translating a problem in the social sector to a well-defined AI problem, in the development and execution of algorithms and solutions to the problem, in the successful and scaled deployment of the AI solution, and in defining appropriate metrics to evaluate the effectiveness of the deployed solution.

In order to apply machine learning for social good, you will need to understand user challenges and their context, curate and transform data, train and validate models, run simulations, and broadly derive insights from data. In doing so, you will work in cross-functional teams spanning ML modeling, engineering, product, and domain experts. You will also interface with social sector organizations as appropriate.  

REQUIREMENTS

Associate ML scientists will have a strong academic background in a quantitative field (see below) at the Bachelor’s or Master’s level, with project experience in applied machine learning. They will possess demonstrable skills in coding, data mining and analysis, and building and implementing ML or statistical models. Where needed, they will have to learn and adapt to the requirements imposed by real-life, scaled deployments. 

Candidates should have excellent communication skills and a willingness to adapt to the challenges of doing applied work for social good. 

DESIRED QUALIFICATIONS

  • B.Tech./B.E./B.S./M.Tech./M.E./M.S./M.Sc. or equivalent in Computer Science, Electrical Engineering, Statistics, Applied Mathematics, Physics, Economics, or a relevant quantitative field. Work experience beyond the terminal degree will determine the appropriate seniority level.
  • Solid software engineering skills across one or multiple languages including Python, C++, Java.
  • Interest in applying software engineering practices to ML projects.
  • Track record of project work in applied machine learning. Experience in applying AI models to concrete real-world problems is a plus.
  • Strong verbal and written communication skills in English.
mls