Langfuse LLM observability

[!NOTE]

• Infra proposal
• Deployment & project plan

https://langfuse.cofacts.tw

• Only cofacts.tw emails can create account
• Can make trace public to act as discussion material
• Each git repository uses 1 Langfuse project.

rumors-api

Record AI reply & transcripts.

[!TIP] DONE: https://github.com/cofacts/rumors-api/pull/355

rumors-line-bot

Use Langfuse to visualize 1-1 conversation between user and Cofacts bot

[TBA]

Takedowns

• Record AI classifier result
• [Optional] store prompt in Langfuse?

[!TIP] DONE: https://github.com/cofacts/takedowns/pull/138/files