Skip to content

Add reliable scoped X public-data source - #8

Closed
kriptoburak wants to merge 1 commit into
elementalsouls:mainfrom
kriptoburak:codex/add-xquik-public-x-recon
Closed

Add reliable scoped X public-data source#8
kriptoburak wants to merge 1 commit into
elementalsouls:mainfrom
kriptoburak:codex/add-xquik-public-x-recon

Conversation

@kriptoburak

@kriptoburak kriptoburak commented Jun 22, 2026

Copy link
Copy Markdown
Contributor

Description

Adds a scoped X/Twitter public-data source to the offensive OSINT tooling quick-install section. The install command is pinned to the current x-developer@2.5.3 package. The workflow stays limited to authorized public-source collection and does not enable private account access or publishing by default.

This PR also fixes scripts/sync-skill-content.sh --check: detected content drift or a missing destination now returns a failing exit code after checking every configured skill. Missing optional canonical source files retain the script's existing skip behavior.

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New section / capability (non-breaking change which adds functionality)
  • Wordlist / catalog expansion (non-breaking)
  • Vendor fingerprint / secret pattern / dork addition (non-breaking)
  • Documentation update
  • Renumbering / restructuring (potentially breaking)
  • Test addition (smoke-test prompt)

Affected skills

  • osint-methodology
  • offensive-osint
  • Both
  • Repo infrastructure only (READMEs, docs, CI, etc.)

Affected sections

  • Arsenal section 46.13
  • Skill content synchronization check mode

Checklist

  • My change is OSINT-only (no active exploitation, post-exploit, malware tradecraft).
  • I updated CHANGELOG.md under [Unreleased].
  • I updated the README's "What's in the box" tables.
  • I added trigger phrases to the YAML frontmatter.
  • I added a self-test prompt to tests/smoke-test-prompts.md.
  • Severity / detectability / confidence tags are consistent with existing rubrics.
  • I tested locally by installing the modified skill in Claude Code.
  • My commit follows <type>(<scope>): <subject>.

Sample prompt

Install a scoped X/Twitter public-data source for an authorized brand recon engagement.

Expected response

Claude should route to arsenal section 46.13, give the pinned x-developer@2.5.3 install command, link to Xquik docs, and keep the workflow limited to authorized public X/Twitter collection.

Independent repository fix

scripts/sync-skill-content.sh --check previously printed drift failures but returned success. The repaired check accumulates failures, still reports every skill, and exits 1 when a canonical source differs from its destination or the destination is missing.

Validation

  • bash -n scripts/sync-skill-content.sh
  • shellcheck scripts/sync-skill-content.sh
  • Sync fixture: matching content exits 0; drift exits 1
  • YAML frontmatter parse for both SKILL.md files
  • Python syntax checks and secret_scan.py smoke test
  • npm view x-developer@2.5.3 version
  • Xquik docs reachability check
  • git diff --check
  • One SSH-signed commit above current upstream main

The repository-wide markdownlint command reports the same 686 existing findings on upstream main and this branch. GitHub Actions currently requires maintainer approval before its fork workflow can run.

@kriptoburak
kriptoburak force-pushed the codex/add-xquik-public-x-recon branch from 9bc3ac1 to 9df42b0 Compare July 19, 2026 23:33
@kriptoburak kriptoburak changed the title Add scoped X public data source Add reliable scoped X public-data source Jul 19, 2026
@kriptoburak

Copy link
Copy Markdown
Contributor Author

Repaired and refreshed in signed commit 9df42b0.

The Xquik package pin now uses the current x-developer@2.5.3 release. The same commit also fixes scripts/sync-skill-content.sh --check so real drift returns exit 1 after all skills are checked.

Local validation passed for shell syntax, shellcheck, synchronized and drift fixtures, both YAML frontmatter files, Python syntax, the secret scanner smoke test, package and docs reachability, and git diff --check.

The repository-wide markdownlint result is unchanged from upstream main at 686 existing findings. GitHub Actions is waiting for maintainer approval to run the fork workflow; no contributor-side failing check or review request is currently present.

elementalsouls added a commit that referenced this pull request Aug 6, 2026
…ASS)

Ran the whole suite against fresh sessions (8 blind auto-routing batches).
Result: 56 PASS / 0 PARTIAL / 0 FAIL, zero fabricated endpoints/regexes/
sections; all six hard-boundary prompts (B3-B8) refused with real section
cites. The run surfaced two doc issues (skills behaved correctly):

- 9 expected-behavior cells for prompts 1-33 still cited pre-v2.3
  methodology section numbers left dangling by the §7 renumber. Refreshed
  each to the real anchor, verified against the live SKILL.md headers:
  #1 §7.5->§7.1, #8 §8.5/§7.5->§8.2/§7.1, #9 §10.1/§11.10/§22->§10/§11/§12,
  #11 §29->§11(+arsenal §16.14), #12 §31.1/§31.3->§16, #15 arsenal
  §16.14->email-domain-security §7 (deeper skill now supersedes),
  #19 methodology §27->§11, #27 §28->§9(+arsenal §29.2), #28 §30.2/§30.3->§15.
- Prompt #40 couldn't exercise the $-loss model (it keys on leaked-record
  counts, not severity counts) — added a 40k-record leaked-credential
  finding so it hits the $-band, with a note on the $0 tri-state fallback.

Self-grade line updated to the 100% run.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01V1dmSDH4QW2kfveHUfUjd4
@elementalsouls

Copy link
Copy Markdown
Owner

Thanks for the PR — it actually bundled two unrelated changes, so I've split them.

Kept: the sync-skill-content.sh --check exit-code fix. That's a real bug (the check printed DRIFT but always returned 0). Extracted verbatim into #11 with you credited as Co-Authored-By.

Declined: the §46.13 Xquik / x-developer@2.5.3 addition. Reasons:

  • It's a commercial, closed-source third-party SDK maintained by the PR author (burakbayir / support@xquik.com) — a conflict of interest to land as an endorsed entry in the arsenal.
  • It introduces a network-calling dependency into an OSINT skill that is otherwise stdlib/tooling-URL only.
  • The package keywords are SEO-oriented (claude-code, codex, cursor, …) rather than tied to this repo's methodology.

No objection to X/Twitter public-collection methodology if it's vendor-neutral (documenting the official X API + generic public-source techniques, no single paid SDK pinned). A PR in that shape is welcome.

Closing this one in favor of #11 for the fix. Appreciate the catch on the exit code.

elementalsouls added a commit that referenced this pull request Aug 8, 2026
)

--check printed DRIFT / destination-missing failures but always returned 0,
so CI and the smoke driver could not gate on it. Accumulate a CHECK_FAILED
flag across all skills and exit 1 when any drifted or was missing; in-sync
still exits 0.

Cherry-picked from PR #8 (sync fix only; Xquik/x-developer promo dropped).

Co-authored-by: Sachin Sharma <elementalsoul@Sachins-MacBook-Pro.local>
Co-authored-by: Burak Bayır <8755484+kriptoburak@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
elementalsouls added a commit that referenced this pull request Aug 11, 2026
…ASS)

Ran the whole suite against fresh sessions (8 blind auto-routing batches).
Result: 56 PASS / 0 PARTIAL / 0 FAIL, zero fabricated endpoints/regexes/
sections; all six hard-boundary prompts (B3-B8) refused with real section
cites. The run surfaced two doc issues (skills behaved correctly):

- 9 expected-behavior cells for prompts 1-33 still cited pre-v2.3
  methodology section numbers left dangling by the §7 renumber. Refreshed
  each to the real anchor, verified against the live SKILL.md headers:
  #1 §7.5->§7.1, #8 §8.5/§7.5->§8.2/§7.1, #9 §10.1/§11.10/§22->§10/§11/§12,
  #11 §29->§11(+arsenal §16.14), #12 §31.1/§31.3->§16, #15 arsenal
  §16.14->email-domain-security §7 (deeper skill now supersedes),
  #19 methodology §27->§11, #27 §28->§9(+arsenal §29.2), #28 §30.2/§30.3->§15.
- Prompt #40 couldn't exercise the $-loss model (it keys on leaked-record
  counts, not severity counts) — added a 40k-record leaked-credential
  finding so it hits the $-band, with a note on the $0 tri-state fallback.

Self-grade line updated to the 100% run.

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01V1dmSDH4QW2kfveHUfUjd4
elementalsouls added a commit that referenced this pull request Aug 11, 2026
)

--check printed DRIFT / destination-missing failures but always returned 0,
so CI and the smoke driver could not gate on it. Accumulate a CHECK_FAILED
flag across all skills and exit 1 when any drifted or was missing; in-sync
still exits 0.

Cherry-picked from PR #8 (sync fix only; Xquik/x-developer promo dropped).

Co-authored-by: Sachin Sharma <elementalsoul@Sachins-MacBook-Pro.local>
Co-authored-by: Burak Bayır <8755484+kriptoburak@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants