{% extends "base.html.jinja" %} {% include "partials/flash_messages.html.jinja" %} {% block title %}Home - SciPaperLoader{% endblock title %} {% block content %}

Welcome to SciPaperLoader

Your comprehensive paper management and scraping platform

Automate paper collection, manage metadata, and monitor download progress with intelligent scheduling

🚀 Core Features

🎛️ Scraper Control Panel

Start, pause, and monitor the automated paper scraping process. View real-time statistics, activity charts, and process individual papers on demand.

Open Control Panel
📚 Paper Management

Browse, search, and manage your paper collection. View download status, inspect metadata, export data, and handle failed downloads.

Browse Papers
📄 CSV Data Import

Bulk import paper metadata from CSV files. Supports 37-column format with intelligent duplicate detection and comprehensive error reporting.

Import Data

⚙️ Configuration & Monitoring

🕒 Download Scheduling

Configure hourly download quotas and timing patterns. Set different rates for day/night hours to optimize bandwidth usage and avoid detection.

Manage Schedule
🔧 System Configuration

Adjust global settings including daily volume limits, download paths, and scraper module selection for optimal performance.

System Settings
📊 Activity Logs

Monitor system activity, track scraping progress, and troubleshoot issues with comprehensive logging and activity timeline views.

View Logs

🔬 Advanced Features

🗄️ Database Management

Manage your paper database with tools for generating test data, cleaning up records, and database maintenance operations.

Database Tools
🧠 Intelligent Processing

Background daemon with randomized timing, human-like behavior patterns, and automatic retry mechanisms for robust paper collection.

Auto-Retry Smart Timing Rate Limiting
{% endblock content %}