feat: 任务进度实时展示、接口测试、暗色主题重构及多项 bug 修复
后端 - 新增 app/task_progress.py 线程安全进度注册表 - 任务改为后台线程异步执行(_run_task_background),手动触发立即返回 task_key - 6 个任务函数(summarizer/tagger/scorer/deduplicator/brief/taxonomy)循环内上报进度 - scheduler 定时任务同步上报进度(trigger=scheduled) - 新增 GET /api/tasks/progress 与 POST /api/tasks/progress/reset 接口 - 新增 POST /api/test-connection 接口连通性测试(独立短超时客户端) - 修复 ai_client/rss_client 配置在 import 时固化的 bug(改为 property 运行时读取 settings), 导致实际任务用 .env 假 key 调 LLM 401 - 修复 ai_client 对 reasoning 模型(MiniMax-M3 等)输出 <think> 块的 JSON 解析失败 - 修复 taxonomy bootstrap:LLM 超时(改用 300s 专用 client)、MiniMax 输出审查 (精简样本仅标题 + 约束生成中性类目名)、失败误报 success(改抛异常如实标记) - 修复 models.py 双外键关系映射启动崩溃(显式 foreign_keys) - 修复 main.py SPA 路由 404、ArticleOut.published_at 序列化 500 - 移除 lifespan 同步 bootstrap 阻塞启动,改由 scheduler 后台异步执行 前端 - Deep Ink 高对比度暗色主题重构,修复 Element Plus 暗色模式对比度问题 - Tasks 页面任务进度实时展示(进度条/阶段/计数/状态/触发来源)+ 1.5s 轮询 - 接口测试面板(rssKeeper / LLM 连通性 + 延迟) - 修复 nextJobs jobId 映射 bug 部署与文档 - Dockerfile 优化(BuildKit 缓存挂载、预编译 wheel、去 gcc、阿里云镜像源) - 新增 API.md 接口文档 Co-Authored-By: Claude <noreply@anthropic.com>
This commit is contained in:
+6
-1
@@ -7,6 +7,7 @@ from sqlalchemy.orm import Session
|
||||
|
||||
from app.ai_client import ai_client
|
||||
from app.rss_client import rss_client
|
||||
from app.task_progress import update_progress, report_loop_progress
|
||||
from config import settings
|
||||
from models import EnrichedArticle
|
||||
|
||||
@@ -109,11 +110,13 @@ def fetch_and_summarize(db: Session, hours: int = 24, limit: int = 200) -> Dict[
|
||||
articles = rss_client.fetch_recent(hours=hours, limit=limit)
|
||||
if not articles:
|
||||
logger.info("未拉取到新文章")
|
||||
update_progress("summarize", status="running", stage="无新文章", current=0, total=0, message="未拉取到新文章")
|
||||
return {"fetched": 0, "created": 0, "summarized": 0}
|
||||
|
||||
stats = {"fetched": len(articles), "created": 0, "summarized": 0}
|
||||
update_progress("summarize", status="running", stage="拉取文章并生成摘要", current=0, total=len(articles))
|
||||
|
||||
for raw in articles:
|
||||
for i, raw in enumerate(articles):
|
||||
data = _article_from_rss(raw)
|
||||
article = db.query(EnrichedArticle).filter(
|
||||
EnrichedArticle.rk_article_id == data["rk_article_id"]
|
||||
@@ -146,6 +149,8 @@ def fetch_and_summarize(db: Session, hours: int = 24, limit: int = 200) -> Dict[
|
||||
if stats["summarized"] % 10 == 0:
|
||||
db.commit()
|
||||
|
||||
report_loop_progress("summarize", i + 1, len(articles), "生成摘要")
|
||||
|
||||
db.commit()
|
||||
logger.info(
|
||||
"摘要任务完成: fetched=%d, created=%d, summarized=%d",
|
||||
|
||||
Reference in New Issue
Block a user