Skip to content

Added language detection and KV-based usage analytics #51

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
dineshsutihar merged 2 commits into from
Oct 14, 2025
Merged

Added language detection and KV-based usage analytics #51

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
3c448d4
Added language detection and KV-based usage analytics
hemanth5055 Oct 12, 2025
c8bd2f4
fix issues according to copilot review
hemanth5055 Oct 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
71 changes: 56 additions & 15 deletions backend/src/index.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@ import { GoogleGenerativeAI } from '@google/generative-ai';

export interface Env {
RATE_LIMIT: KVNamespace;
LANG_TRANSLATION_ANALYTICS: KVNamespace;
GEMINI_API_KEY: string;
}

Expand All @@ -15,7 +16,7 @@ const MAX_REQUESTS_ALLOWED = 10;
const DURATION = 60_000;

async function checkRateLimit(ip: string, env: Env) {
const key = `ip_key:${ip}`;
const key = `ip_key:${ip}`.toLowerCase();
const now = Date.now();
let value = await env.RATE_LIMIT.get(key);
let data = { count: 0, time: now };
Expand All @@ -38,7 +39,25 @@ async function checkRateLimit(ip: string, env: Env) {

return data.count <= MAX_REQUESTS_ALLOWED;
}
async function handleTranslate(request: Request, model: ReturnType<GoogleGenerativeAI['getGenerativeModel']>) {

async function updateAnalytics(source: string, dest: string, env: Env) {
const key = `${source}-${dest}`;
Copy link

Copilot AI Oct 13, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The analytics key should be normalized (lowercase and trimmed) to avoid duplicates, similar to how the rate limit key is handled on line 19.

Suggested change
const key = `${source}-${dest}`;
const normalizedSource = source.trim().toLowerCase();
const normalizedDest = dest.trim().toLowerCase();
const key = `${normalizedSource}-${normalizedDest}`;

Copilot uses AI. Check for mistakes.
let value = await env.LANG_TRANSLATION_ANALYTICS.get(key);

let data = { count: 0 };
if (value) {
try {
data = JSON.parse(value);
} catch {
data = { count: 0 };
}
}

data.count += 1; // increment usage count

await env.LANG_TRANSLATION_ANALYTICS.put(key, JSON.stringify(data));
}
async function handleTranslate(request: Request, model: ReturnType<GoogleGenerativeAI['getGenerativeModel']>, env: Env) {
const { code, targetLanguage } = await request.json<{ code: string; targetLanguage: string }>();

if (!code || !targetLanguage) {
Expand All @@ -47,7 +66,7 @@ async function handleTranslate(request: Request, model: ReturnType<GoogleGenerat
headers: { ...corsHeaders, 'Content-Type': 'application/json' },
});
}

const sourceLanguage = await detectLanguage(code, model);
const prompt = `Translate the following code snippet to ${targetLanguage}.
Do not add any explanation, commentary, or markdown formatting like \`\`\` around the code.
**IMPORTANT: Preserve all original comments and their exact placement in the translated code. Do not add extra spaces in between.**
Expand All @@ -58,8 +77,8 @@ ${code}`;

const result = await model.generateContent(prompt);
const translatedCode = result.response.text();

return new Response(JSON.stringify({ translation: translatedCode }), {
await updateAnalytics(sourceLanguage, targetLanguage, env);
return new Response(JSON.stringify({ translation: translatedCode, sourceLanguage }), {
status: 200,
headers: { ...corsHeaders, 'Content-Type': 'application/json' },
});
Expand Down Expand Up @@ -102,23 +121,34 @@ export default {

try {
const ip = request.headers.get('CF-Connecting-IP') || 'unknown';
const allowed = await checkRateLimit(ip, env);
if (!allowed) {
return new Response(JSON.stringify({ error: "Too many requests. Try again later." }), {
status: 429,
headers: { ...corsHeaders, 'Content-Type': 'application/json' },
});
}
const allowed = await checkRateLimit(ip, env);
if (!allowed) {
return new Response(JSON.stringify({ error: 'Too many requests. Try again later.' }), {
status: 429,
headers: { ...corsHeaders, 'Content-Type': 'application/json' },
});
}
const url = new URL(request.url);
const path = url.pathname;
const genAI = new GoogleGenerativeAI(env.GEMINI_API_KEY);
const model = genAI.getGenerativeModel({ model: 'gemini-2.0-flash' });
if (path === '/v1/analytics') {
const list = await env.LANG_TRANSLATION_ANALYTICS.list();
const stats: Record<string, any> = {};
for (const key of list.keys) {
const val = await env.LANG_TRANSLATION_ANALYTICS.get(key.name);
stats[key.name] = JSON.parse(val || '{}');
Copy link

Copilot AI Oct 13, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

JSON.parse should be wrapped in a try-catch block to handle potential parsing errors, similar to the error handling in updateAnalytics function.

Suggested change
stats[key.name] = JSON.parse(val || '{}');
try {
stats[key.name] = JSON.parse(val || '{}');
} catch (e) {
console.error(`Failed to parse analytics value for key "${key.name}":`, e);
stats[key.name] = {};
}

Copilot uses AI. Check for mistakes.
}
return new Response(JSON.stringify(stats, null, 2), {
headers: { ...corsHeaders, 'Content-Type': 'application/json' },
});
}

if(path==="/test-rate-limit"){
return new Response(JSON.stringify("Proceed !"))
if (path === '/test-rate-limit') {
return new Response(JSON.stringify('Proceed !'));
}
if (path === '/' || path === '/v1/translate') {
return await handleTranslate(request, model);
return await handleTranslate(request, model, env);
}

if (path === '/v1/explain') {
Expand All @@ -138,3 +168,14 @@ export default {
}
},
};

async function detectLanguage(code: string, model: ReturnType<GoogleGenerativeAI['getGenerativeModel']>) {
const prompt = `Identify the programming language of the following code.
Only respond with the exact language name (e.g., "python", "javascript", "c++", "java", etc.) without any extra text or punctuation.

Code:
${code}`;

const result = await model.generateContent(prompt);
return result.response.text().trim();
Copy link

Copilot AI Oct 13, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The detectLanguage function should normalize the returned language name to lowercase to ensure consistent analytics keys, preventing duplicate entries like 'Python' vs 'python'.

Suggested change
return result.response.text().trim();
return result.response.text().trim().toLowerCase();

Copilot uses AI. Check for mistakes.
}
6 changes: 5 additions & 1 deletion backend/wrangler.jsonc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,11 @@
"kv_namespaces": [
{
"binding": "RATE_LIMIT",
"id": "<your_kv_id>"
"id": "<your_kv_id>",
}
,{
"binding": "LANG_TRANSLATION_ANALYTICS",
"id":"<your_kv_id>"
}
]

Expand Down