goget/BACKLOG.md

Backlog — goget

This file tracks planned features and improvements across releases. Items are grouped by target version and priority. Completed items move to CHANGELOG.md when the version ships.

---

v1.1.0 — Protocol completeness

Finish the protocol layer so every supported protocol handles recursive, parallel, resume, and shutdown correctly.

🔴 Supreme Priority

• Graceful shutdown for all protocols — persist .goget.meta on SIGINT for FTP single-file and SFTP parallel recursive paths.
• WebDAV connection pooling — shared http.Transport across WebDAV requests instead of a fresh transport per request (currently defeats HTTP keep-alive, TLS session resumption, and HTTP/2 multiplexing).

🟡 High Priority

• WebDAV recursive parallel downloads — extend --recursive-parallel to WebDAV using the shared transport.
• SFTP recursive parallel downloads — parallel SFTP recursive with session pooling.
• FTP recursive parallel — connection pool for independent control connections in FTP recursive mode.
• --dry-run for WebDAV recursive — list matched entries without downloading.

🟢 Medium Priority

• --adjust-extension for non-HTML protocols — apply .html extension to text/html files from WebDAV, Gopher.
• --backup-converted for WebDAV mirrors — keep .orig backups before link conversion.
• Parallel recursive across all protocols — unified worker pool independent of protocol handler.

---

v1.2.0 — curl/wget parity & UX

Close the gap with curl and wget, and improve scripting/automation UX.

🟡 High Priority

• --create-dirs — auto-create parent directories for --output paths (curl --create-dirs / wget --directory-prefix equivalent).
• Short flags — -O, -o, -s, -v aliases for curl/wget muscle memory. --output-document alias for --output.
• Brotli decompression — RFC 7932, written from scratch. Currently only gzip/deflate/bzip2/LZW.

🟢 Medium Priority

• --progress=bar:force:noscroll — curl-compatible progress options.
• --metalink --follow-metalink=mem — keep Metalink in memory instead of writing to disk.
• Bandwidth throttling per-domain — global rate limit only at present.
• MIME type detection for local files — determine Content-Type from file extension when uploading.
• --cut-dirs for recursive mode — strip directory components from output paths.
• Notification hooks — --on-error with richer environment variables (exit code, error type, checksum).
• Retry with backoff visualization — show retry attempts in progress bar (attempt 2/3, waiting 4s...).
• Idempotent --resume — auto-detect whether resume is possible without manual flag.
• --show-metadata — display .goget.meta contents for debugging.

🔵 Lower Priority

• URL glob expansion (--glob) — expand [1-3] and {a,b} patterns in URLs.

---

v1.3.0 — Security hardening

TLS, authentication, and verification improvements.

🔴 Supreme Priority

• PGP replacement — golang.org/x/crypto/openpgp is frozen (archived by Go team). Evaluate: inline a minimal subset, or wait for a community golang.org/x/ successor.

🟡 High Priority

• --pinned-cert for all TLS protocols — extend certificate pinning to FTPS, SFTP, Gemini, and WebDAVS (currently HTTP/HTTPS only).
• SOCKS5 proxy for non-HTTP protocols — FTP and SFTP through SOCKS5 proxy (currently HTTP/HTTPS only).
• DNS-over-HTTPS (DoH) — optional DoH resolver. Must use only golang.org/x/ libraries.

🟢 Medium Priority

• Structured error output with --json — machine-readable error objects with type, message, URL, and hint fields.

---

v2.0.0 — New protocols

Cloud providers, additional network protocols, and long-lived services.

🔵 Lower Priority

• S3 — generic S3-compatible protocol with signature v4 auth (covers AWS S3, MinIO, and any S3-compatible storage).
• Huawei OBS — Huawei Cloud Object Storage.
• Alibaba OSS — Alibaba Cloud Object Storage Service.
• Tencent COS — Tencent Cloud Object Storage.
• Rsync — incremental file transfer. Written from scratch (rolling checksum, delta transfer, rsync wire protocol).
• TFTP — trivial file transfer, useful for embedded devices and PXE.
• NFS — NFS v3/v4 client. Written from scratch (ONC RPC/XDR, portmapper, mount protocol, NFS protocol).
• goget-as-a-service — daemon mode with REST API for remote download management.

---

v2.1.0 — Extensibility & UI

🔵 Lower Priority

• Plugin system — protocol handlers as external plugins.
• TUI (Terminal User Interface) — interactive download manager with live queue, progress, and log views. Keyboard navigation, color-coded status, inline log viewer.
• Web GUI — browser-based download manager (Vue 3 frontend, REST API, live progress via SSE).
• Download speed test / benchmark mode — measure maximum throughput against a target server without saving the file.

---

💡 Backlog (unscheduled)

Items that need more design, depend on external factors, or are lower priority than the versioned roadmap.

Performance

• Memory-mapped I/O for large files — mmap for checksum verification of multi-gigabyte downloads.
• Zero-copy for file:// and data: protocols — sendfile(2) / splice(2) where available on Linux.
• HTTP/3 (QUIC) — when Go stdlib gains QUIC support.

Advanced UX

• Scheduling — pause/resume queued downloads — ability to pause the queue, reorder items, and resume later.

Code Quality & Testing

• Integration test matrix — CI against real FTP, SFTP, and WebDAV servers.
• Coverage threshold increase — raise from 40% to 60%.
• Benchmark suite — go test -bench in CI.
• Fuzzing corpus in CI — store and replay past crashes automatically.
• internal/log migration — migrate remaining ~140 fmt.Fprintf and cli.Print* callsites to log.Infof.
• unsafe audit — verify no unsafe usage outside build-tag-gated platform-specific code.

Project Infrastructure

• RPM spec file — Fedora / RHEL / openEuler packaging.
• FreeBSD port — official FreeBSD ports tree entry.
• systemd unit — for daemon / scheduled mode.

Documentation

• Man page packaging — already generated by --generate-man-page, needs installation via packaging.
• Architecture decision records — document why specific choices were made (no short flags, IPv6-first, long flags only, no global state).
• Protocol-specific guides — one doc per protocol with examples.
• Troubleshooting guide — common errors and solutions.