lei.chen
4e894d2184
merge: sync Rongsong's scheduler-framework into chatbot
...
Full merge of origin/scheduler-framework (scheduler-core restructure,
failover-adoption, WAL_JOB_DISPATCH, apiserver backend health/heartbeat,
build-time versioning, bug-1673/1676/1678/1679/1680).
Conflict resolution:
- scheduler: adopt Rongsong's scheduler-core architecture (driver loop,
queue project/picker fields, resource bug-1569 fix)
- worker/controller_connector.c: keep Rongsong's reconnect/rejoin
structure, PORT our bug-1509 resend_job_status onto the rejoin success
path (his reconnect didn't re-report job state)
- apiserver backend: take Rongsong's health/heartbeat (supersedes our
e505066
2026-08-25 12:33:16 +00:00
d70bf6a402
update documents
2026-08-10 17:51:51 +08:00
lei.chen
62dee0edc1
fix(configs): add worker-builtin load indices missing from resources.yaml
...
worker/src/resource_sync.c init_builtin_load_indices registers 11 load
indices (r15s/r1m/r15m/ut/pg/ls/it/swp/mem/tmp/io) but resources.yaml only
defined r1m/r15s/mem/tmp. The 7 missing ones (r15m/ut/pg/ls/it/swp/io) caused
controller "update_resval: Success" ERRORs and scheduler "unknown resource in
per-worker resvals update" warnings, leaving the worker resource view
incomplete. Add the 7 definitions matching the existing r1m/r15s pattern.
Docs: log bug-1494 (all jobs PEND, scheduler never dispatches; after this
config fix jobs still PEND — remaining suspect is the scheduler→controller
join path after restart), update design doc + verification manual known-issue
tables and root CLAUDE.md cluster-verification status.
Co-Authored-By: Claude <noreply@anthropic.com>
2026-08-02 07:36:03 +00:00
lei.chen
9fe14c1512
docs(scheduler-agent): update design doc with cluster verification results
...
- Design doc v1.2: Phase 0-1 cluster verification status (read + submit OK,
control HTTP 500 open bug-1490), bug table for whitelist/job_status fixes,
mcp_operator queue:control note.
- Root + frontend CLAUDE.md: reflect verified state and apiserver bugs found.
- wolf memory/anatomy/buglog: log deployment session, bug-1489/bug-1490.
Co-Authored-By: Claude <noreply@anthropic.com>
2026-08-01 09:54:49 +00:00
Lei Chen
e4af0cac73
Phase 0: scheduleragent + mcp-server read-only agent framework
...
Complete the natural-language scheduler agent's Phase 0 read-only pipeline:
Task #2 (API Key auth mechanism):
- New store/apikey.go: APIKey store (hash, validate, expiry)
- controllers/apikey.go: GenerateAPIKey finally persists + registers RBAC role
- controllers/auth.go: GetUsernameFromToken recognizes xce_ak_ prefix
- middleware/validatehandler.go: isValidToken handles API Key
- config/rbac.yaml: mcp_readonly role (view-only permissions)
- 6 new test files covering unit + integration full-chain
Task #3 (schedulerclient Go library):
- types.go: URM types (URMJob/URMQueue/URMNode/JobStatus/Metrics)
- client.go: read-only Client interface (6 methods)
- httpclient.go: resty-based HTTP implementation
- statusmap.go + _test.go: TDD status mapping (33 tests)
Task #4 (mcp-server binary):
- cmd/main.go: entry, reads XCE_API_URL/XCE_API_KEY, registers 6 MCP tools
- internal/app.go: tool handlers wiring schedulerclient to MCP stdio
- Uses github.com/mark3labs/mcp-go@v0.57.0 for stdio transport
All: go vet clean, go build clean, schedulerclient 33/33 tests pass.
mcp-server binary ~11MB arm64, CGO_ENABLED=0.
Architecture:
Claude Code --stdio--> mcp-server --HTTP--> apiserver REST API --cgo--> C backend
Co-Authored-By: Claude <noreply@anthropic.com>
2026-07-30 11:16:36 +08:00
06135954ff
chore: baseline snapshot — prior-session work + ha-consistency-invariants spec family
...
Pre-existing uncommitted work: ha-repl-hardening payload data plane (7.x),
heartbeat liveness fix (Req 1.3), connection-reuse ASAN fixes, doc cleanup.
New: ha-consistency-invariants umbrella (requirements/design/research) and
its four implementation sub-specs (specs generated via batch, cross-spec
review applied), steering roadmap + product.md Raft+CP decision.
2026-06-11 13:21:50 +00:00
fa66d1ba9c
finalize configuration replication
2026-06-09 16:40:13 +08:00
e31673dd88
chore: checkpoint all prior work for clean state
...
Captures all uncommitted work from ha-config-bootstrap,
ha-heartbeat-liveness, and associated spec/tooling updates:
- src: ha.c, ha.h, cluster.c, config_repl.c, myapp.c, raft.c —
heartbeat liveness, RDHUP integration, committing phase fixes
- tests: test_ha_role.c, test_config_repl.c, test_ha_rdhup_integration.c,
test_p1_integration.c, test_p3_hardening.c, scheduler test
- specs: election-iomgr-refactor, ha-heartbeat-liveness,
ha-peer-connection-reuse, raft-library (new); ha-config-bootstrap
and election-iomgr-refactor task/research updates
- tooling: .wolf/ state, ha/data cluster fixtures, raft/raft.tla,
src/build symlink, xce-build skill update
2026-06-04 13:04:16 +00:00
7b39650229
refactor(ha): passive standby model — primary connects outbound to all peers
...
Remove fetch_config_from_primary, ha_find_and_connect_to_primary, and the
tier-1/2/3 discovery path. Standbys never initiate outbound connections to
the primary; the primary owns all inter-controller channels.
Key changes:
- ha.c: add primary heartbeat loop (ha_start_primary_heartbeat) that sends
OPCode_nop to connected standbys every heartbeat_interval_ms; loop
self-cancels on demotion via role check before re-arm.
- ha.c: add outbound reconnect in primary_heartbeat_fn — for peers absent
from standby_endpoints, open fresh outbound TLS connection (on_standby_connected
sends ctrlhello; standby_ep_ctx_t mirrors vote_ep_ctx_t layout).
- ha.c: remove ha_find_and_connect_to_primary + helpers (ha_raw_tcp_connect,
ha_tcp_connect_hook); remove election_timeout_fn (superseded by
raft_election_timeout_fn); remove fetch_config_from_primary call from
ha_elect_evaluate_and_signal STANDBY branch.
- cluster.c: OPCode_requestVote denial no longer reuses inbound connection;
late joiners are bootstrapped via primary heartbeat outbound connect.
- config_repl.c: remove connect_ssl_raw, do_one_config_fetch,
fetch_config_from_primary (~250 LOC).
- myapp.c: remove my_tag > 0 fetch branch; all standbys wait passively.
- ha.h: remove ha_find_and_connect_to_primary declaration + macros +
ha_tcp_connect_hook seam; add ha_start_primary_heartbeat declaration.
- meson.build: remove test_ha_connect.c (tests deleted function).
- controller_test.c: remove test_ha_connect registration.
- CLAUDE.md, src/controller/CLAUDE.md: document passive standby model,
inbound-vs-outbound connection ownership, async I/O constraint,
heartbeat model.
- request.h: add xce_request declaration (removes scattered local externs).
2026-06-01 04:17:05 +00:00
c8e0f65a39
enhance xce-build skill
2026-05-30 08:13:59 +08:00
9bbff7b016
claude skills
2026-05-29 15:00:06 +08:00
1599d06bc4
feat: filter lost_and_found sentinel from pushes; reset unavail host attrs
...
- create_lost_and_found(): provide hostattrs_t so makeWorker succeeds
- collect_queues/collect_workers (dataex.c): skip lost_and_found sentinel
so it is never pushed to apiserver or scheduler
- mark_worker_unavail(): reset hosttype/hostmodel to "unknown" and zero
all numeric attrs, then update resvals and slots — prevents stale
capacity from being visible while the host is down
- restore_worker(): apply the same attr reset on WAL recovery so
restored-but-unavailable workers advertise no capacity until reconnect;
also remove dead calloc() that was immediately overwritten by makeWorker
- Extract reset_hostattrs_unknown() helper to eliminate copy-paste
- Define XCE_LOST_AND_FOUND_NAME constant in config_repl.h; replace all
six raw "lost_and_found" string literals across config_repl.c and dataex.c
2026-05-14 08:44:55 +00:00
f80839cd99
add cc-std
2026-05-11 08:19:42 +00:00
d7afd72e5b
fix front end issues
2026-05-01 21:22:45 +08:00
00c4472d6c
Add HostConfig + Cluster fields to models and update docs
2026-04-16 09:24:22 +00:00
c9dc8c4676
Merge Go frontend (apiserver + xcecli) into meson build
2026-04-14 11:23:18 +08:00
