Skip to content

[Buganizer ID: 545411510] Migrate Batch 10: ApacheKafka - #1425

Open
Arabindaksha-Mishra wants to merge 5 commits into
mainfrom
migration_ApacheKafka
Open

Arabindaksha-Mishra wants to merge 5 commits into
mainfrom
migration_ApacheKafka

Conversation

@Arabindaksha-Mishra

Copy link
Copy Markdown
Contributor

[Buganizer ID: 545411510] Migrate Batch 10: ApacheKafka


Description

Migrate the ApacheKafka integration from the legacy GoB repository (tip-marketplace) to the open GitHub repository (content-hub).
Deconstruction: Migrated source code into modular actions/, connectors/, core/, and resources/ structure with standardized relative imports for Chronicle SOAR packaging.
Dependencies: Configured pyproject.toml and uv.lock with required runtime and development dependencies (confluent-kafka==2.4.0, tipcommon, environmentcommon, soar-sdk, integration-testing, and pytest-mock).
Tests: Configured test suite with integration_testing fixtures in conftest.py and verified all 55 unit tests across tests/test_defaults/, tests/test_actions/, tests/test_connectors/, and tests/test_manager.py.
Validation: Verified with mp check, mp validate, mp test, and mp build (100% AST and JSON definition parity against tip-marketplace).


@github-actions

Copy link
Copy Markdown

❌ Marketplace Validation Failed

Click to view the full report

Validation Report

🧩 Integrations

apache_kafka

Validation Name Details
⚠️ Integration Version Bump New integration project.toml and release_note.yaml version must be initialize to 1.0
⚠️ Mapping Rules Validation 'apache_kafka' has connectors but doesn't have default mapping rules
⚠️ SSL Integration Validation Apache Kafka is missing a 'Verify SSL' parameter

@gemini-code-assist

Copy link
Copy Markdown
Contributor

Summary of Changes

Hello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request migrates the ApacheKafka integration to the open-source repository, adopting a modular structure to improve code organization and maintainability. The migration includes updated dependency management and a robust test suite to ensure functional parity with the previous implementation.

Highlights

  • Migration to Open Source: Migrated the ApacheKafka integration from the legacy GoB repository to the open GitHub repository.
  • Modular Architecture: Restructured the codebase into modular actions, connectors, core, and resources directories for improved maintainability.
  • Testing and Validation: Implemented a comprehensive test suite with 55 unit tests and verified full parity with the legacy implementation.
New Features

🧠 You can now enable Memory (public preview) to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize the Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counterproductive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution. ↩

Signed-off-by: Arabindaksha Mishra <109797459+Arabindaksha-Mishra@users.noreply.github.com>
@github-actions

Copy link
Copy Markdown

❌ Marketplace Validation Failed

Click to view the full report

Validation Report

🧩 Integrations

apache_kafka

Validation Name Details
⚠️ Integration Version Bump New integration project.toml and release_note.yaml version must be initialize to 1.0
⚠️ Mapping Rules Validation 'apache_kafka' has connectors but doesn't have default mapping rules
⚠️ SSL Integration Validation Apache Kafka is missing a 'Verify SSL' parameter

1 similar comment
@github-actions

Copy link
Copy Markdown

❌ Marketplace Validation Failed

Click to view the full report

Validation Report

🧩 Integrations

apache_kafka

Validation Name Details
⚠️ Integration Version Bump New integration project.toml and release_note.yaml version must be initialize to 1.0
⚠️ Mapping Rules Validation 'apache_kafka' has connectors but doesn't have default mapping rules
⚠️ SSL Integration Validation Apache Kafka is missing a 'Verify SSL' parameter

@gemini-code-assist gemini-code-assist Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces a new Apache Kafka integration, including ping actions, message connectors, and comprehensive unit tests. The review feedback identifies critical issues regarding consumer initialization to prevent data loss, adherence to path handling style guides, mandatory error message formatting for the Ping action, and minor type annotation typos.

@github-actions

github-actions Bot commented Nov 3, 2026

Copy link
Copy Markdown

❌ Marketplace Validation Failed

Click to view the full report

Validation Report

🧩 Integrations

apache_kafka

Validation Name Details
⚠️ Integration Version Bump New integration project.toml and release_note.yaml version must be initialize to 1.0
⚠️ Mapping Rules Validation 'apache_kafka' has connectors but doesn't have default mapping rules
⚠️ SSL Integration Validation Apache Kafka is missing a 'Verify SSL' parameter

Signed-off-by: Arabindaksha Mishra <109797459+Arabindaksha-Mishra@users.noreply.github.com>
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown

❌ Marketplace Validation Failed

Click to view the full report

Validation Report

🧩 Integrations

apache_kafka

Validation Name Details
⚠️ Integration Version Bump New integration project.toml and release_note.yaml version must be initialize to 1.0
⚠️ Mapping Rules Validation 'apache_kafka' has connectors but doesn't have default mapping rules
⚠️ SSL Integration Validation Apache Kafka is missing a 'Verify SSL' parameter

1 similar comment
@github-actions

github-actions Bot commented Nov 4, 2026

Copy link
Copy Markdown

❌ Marketplace Validation Failed

Click to view the full report

Validation Report

🧩 Integrations

apache_kafka

Validation Name Details
⚠️ Integration Version Bump New integration project.toml and release_note.yaml version must be initialize to 1.0
⚠️ Mapping Rules Validation 'apache_kafka' has connectors but doesn't have default mapping rules
⚠️ SSL Integration Validation Apache Kafka is missing a 'Verify SSL' parameter

@github-actions

github-actions Bot commented Nov 6, 2026

Copy link
Copy Markdown

❌ Marketplace Validation Failed

Click to view the full report

Validation Report

🧩 Integrations

apache_kafka

Validation Name Details
⚠️ Integration Version Bump New integration project.toml and release_note.yaml version must be initialize to 1.0
⚠️ Mapping Rules Validation 'apache_kafka' has connectors but doesn't have default mapping rules
⚠️ SSL Integration Validation Apache Kafka is missing a 'Verify SSL' parameter

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants