Skip to content

sunpcaudio2note/audio2note

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

30 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Audio2Note Service

Build Status Code Coverage Version License Join Waitlist

AI-powered clinical documentation service that transforms audio encounters into structured, accurate, and actionable notes.

Workflow GIF

Overview

Clinical documentation is a critical but time-consuming task for healthcare professionals. The burden of manual data entry leads to burnout, reduces patient face-time, and increases the risk of errors. Audio2Note is a secure, HIPAA-compliant service designed to solve this problem. It provides a seamless workflow to transform audio from patient encounters into structured clinical notes, complete with AI-generated billing codes, which can be integrated into any Electronic Medical Record (EMR) system via a modern REST API.

Key Features

  • 🎙️ Audio Transcription: Upload audio files (.wav, .mp3, .m4a, .flac, .ogg) for fast and accurate transcription.
  • ✍️ Structured Note Generation: Automatically generate structured clinical notes (SOAP, H&P) from transcribed text.
  • AI-Powered Coding: Leverage advanced AI with Chain-of-Thought and Few-Shot prompting for highly accurate ICD-10, HCPCS, and E/M code suggestions.
  • 🔒 HIPAA-Compliant Security: End-to-end encryption, secure data handling, and a commitment to patient privacy.
  • ⚙️ REST API for EMR Integration: A flexible and well-documented REST API allows for seamless integration with any EMR or clinical software.
  • Tiered Priority Processing: A waitlist system prioritizes jobs based on subscription tiers, ensuring faster turnaround for premium users.

Technology Stack

Technology Description
Automatic Speech Recognition (ASR) High-accuracy transcription and speaker diarization.
LLM Fine-Tuning (QLoRA) Efficient fine-tuning of language models on custom datasets.
Custom Dataset Curation Development of specialized datasets for clinical documentation.
Retrieval-Augmented Generation (RAG) Enhancing LLM responses with external knowledge bases.
Advanced AI Prompting Chain-of-Thought and Few-Shot techniques for enhanced accuracy.
Python & LangChain Core backend logic and AI orchestration.
FastAPI High-performance web framework for the REST API.
PostgreSQL & Supabase Robust and scalable data and file storage.
PHP & JavaScript Integration with EMR systems and client-side functionality.

Architecture

The Audio2Note service is built on a decoupled, dual-workflow architecture to ensure security, scalability, and maintainability. An API Gateway workflow handles all external interactions, including authentication, authorization, and rate-limiting, before passing validated jobs to a core processing workflow.

Architecture Diagram

User Workflow

Step 1: Upload or Summarize

User selects to upload an audio file or summarize existing notes.

Step 2: Processing

The service processes the request in the background.

Step 3: Review Note

The generated note is ready for review and use.

Step 4: AI Coding

AI-powered coding suggestions are provided.

Getting Started

Using the Audio2Note service is simple and does not require any local installation or container setup.

  1. Visit our Website: Go to www.audio2note.org.
  2. Start Your Free Trial: You can begin using the service immediately with our free trial period.
  3. Start Transcribing: Use either the secure web form on our website or integrate directly with your own software using our REST API.

API Usage

The Audio2Note REST API provides endpoints for submitting audio files and checking the status of processing jobs. All requests must be authenticated with a valid license key.

  • POST /website_initiate_transcription: Submit a multipart/form-data request with an audio file.
  • GET /website_status: Check the status of a job using its job_id.

For detailed information on endpoints, request/response formats, and authentication, please see our full API Reference.

Further Documentation

Contributing

Our mission is to provide a clinical documentation solution that is private, resource-efficient, and affordable for healthcare professionals. We are passionate about leveraging lightweight, specialized AI to protect patient data and reduce operational costs.

If you share our vision and are interested in contributing, we would love to hear from you. Please reach out to us through our Contact Form to discuss potential collaboration opportunities.

About

from recorded provider-patient conversation to medical note with medical coding

Topics

Resources

Contributing

Stars

Watchers

Forks

Packages

No packages published