🐰 Add RabbitMQ Integration for Chat Log Processing Triggers#2
Open
ChanYoungHan wants to merge 7 commits intoAlexiFeng:mainfrom
Open
🐰 Add RabbitMQ Integration for Chat Log Processing Triggers#2ChanYoungHan wants to merge 7 commits intoAlexiFeng:mainfrom
ChanYoungHan wants to merge 7 commits intoAlexiFeng:mainfrom
Conversation
…at_logger.py, rabbitmq_publisher.py, test_rabbitmq.py, Makefile updated for international collaboration
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🐰 Add RabbitMQ Integration for Chat Log Processing Triggers
📋 Development Background
The existing MCP Chat Logger only supported simple file saving, but we have extended it to use AMQP (RabbitMQ) as a trigger for processing chat logs.
Key reasons for introducing AMQP:
✨ Key Changes
🏗️ Architecture Improvements
utils/rabbitmq_publisher.pyto separate AMQP logicdev-tools/directory🔧 Core Feature Additions
llmLogger(direct type)llm_loggerllm_loggerRABBITMQ_HOST,RABBITMQ_PORT,RABBITMQ_USERNAME,RABBITMQ_PASSWORD🌍 Internationalization and Usability Improvements
📊 Change Statistics
🆕 New Files
utils/rabbitmq_publisher.py- RabbitMQ message publishing moduledev-tools/docker-compose.yml- Development RabbitMQ environmentdev-tools/.env.example- Environment variable templatedev-tools/test_rabbitmq.py- Development connection testingrabbitmq_init/init.sh- RabbitMQ initialization script🔄 Major Modifications
chat_logger.py- Added AMQP integration and automatic mode detection logicREADME.md,README_ko.md,README_en.md- Complete overhaul reflecting new architecturepyproject.toml- Addedpika,python-dotenvdependencies❌ Removed Elements
README_zh.md- Duplicate file cleanup (README.md is in Chinese)Makefile- Replaced with environment variable-based automatic configurationtest_rabbitmq_connection,get_rabbitmq_config)🚀 Usage Examples
RabbitMQ Mode (with environment variables)
File-only Mode (without environment variables)
🔗 Related Issues and Background
This PR aims to build a reliable trigger system for subsequent processing of chat log data. Since file saving alone poses a risk of processing trigger loss, we introduced a message-based trigger system through RabbitMQ to ensure data processing stability and scalability.
This Pull Request is a significant update that advances the existing functionality into a scalable architecture while maintaining backward compatibility. 🎉