System Resilience and Installation Automation Improvements

[sylvain-pierrot]

Summary

This PR introduces significant improvements to the bp-socket system, focusing on installation automation, system resilience under load, and enhanced logging for better observability.

Key Changes

Installation & Automation

• New make install target: Automated installation of kernel module, daemon, headers, and tools
• Systemd service integration: Added service files for bp-socket-daemon, ion-dtn, and ud3tn
• Cloud-init enhancements: Updated provisioning scripts with automatic module loading and service startup
• Build dependencies: Added clang-format, sparse, and libnl-3-dev to build requirements

System Resilience & Performance

• Increased queue capacity: Raised send queue limit from 1,000 to 5,000 elements to handle traffic spikes
• Improved error handling: Enhanced logging with payload sizes and queue metrics for better debugging
• Thread synchronization fix: Fixed race condition in ion_send_thread loop logic
• Resource cleanup: Corrected Netlink socket cleanup order to prevent resource leaks

Logging & Observability

• Structured logging: Improved log messages with consistent formatting and more context
• Reduced log noise: Moved verbose technical logs to debug level
• Better error context: Added command IDs and endpoint information to Netlink error messages
• Performance monitoring: Added queue size warnings for proactive issue detection

🎯 Benefits

• Easier deployment: One-command installation with make install
• Better reliability: System handles high load scenarios more gracefully
• Improved debugging: Enhanced logging provides better visibility into system behavior
• Production ready: Systemd services enable proper service management