Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly
Sign up
Appearance settings

Performance test improvements #384

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
emasab wants to merge 16 commits into master
base: master
Choose a base branch
Loading
from dev_performance_test_improvements
Open
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
16 commits
Select commit Hold shift + click to select a range
77b687b
Performance test improvements, measure eachBatch rate, time and lag, ...
emasab Oct 8, 2025
ebef2af
Run performance tests with SASL_PLAINTEXT or SASL_SSL and plain authe...
emasab Oct 9, 2025
45c4097
Fixes
emasab Oct 9, 2025
b71e51b
Improve KafkaJS producing, more reliable createTopics, configurable m...
emasab Oct 14, 2025
d95680b
Log number of partitions
emasab Oct 14, 2025
33bd5ec
Fix skipCtpTest
emasab Oct 14, 2025
e332111
Configurable partitions consumed concurrently
emasab Oct 14, 2025
073e0a6
Consume rate in msg/s, average batch size, different messages dependi...
emasab Oct 14, 2025
8ffd977
fixup
emasab Oct 14, 2025
948d590
Average and max E2E latency
emasab Oct 14, 2025
ac0d674
Log average and max size
emasab Oct 14, 2025
9a5db79
Changes to run the test for a longer time
emasab Oct 15, 2025
ed0fb03
Add broker lag monitoring
emasab Oct 15, 2025
476a38e
fixup
emasab Oct 16, 2025
9f4461f
Use same producer and different E2E latencies
emasab Oct 17, 2025
77556ce
Auto commit on batch end
emasab Oct 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Log number of partitions
  • Loading branch information
emasab committed Oct 15, 2025
commit d95680b65a2fbf8f0efd4c11bcdab1559ac475cd

Some comments aren't visible on the classic Files Changed page.

1 change: 1 addition & 0 deletions examples/performance/performance-consolidated.js
View file Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -95,6 +95,7 @@ function logParameters(parameters) {
logParameters(parameters);
console.log(` Topic: ${topic}`);
console.log(` Topic2: ${topic2}`);
console.log(` Partitions: ${numPartitions}`);
await runCreateTopics(parameters, topic, topic2, numPartitions);
}

Expand Down
4 changes: 2 additions & 2 deletions examples/performance/performance-primitives-kafkajs.js
View file Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ async function runCreateTopics(parameters, topic, topic2, numPartitions) {
topics: [{ topic: t, numPartitions }],
}).catch(console.error);
if (topicCreated) {
console.log(`Created topic ${t}`);
console.log(`Created topic ${t} with ${numPartitions} partitions`);
continue;
}

Expand All @@ -55,7 +55,7 @@ async function runCreateTopics(parameters, topic, topic2, numPartitions) {
{ topic: t, numPartitions },
],
}).catch(console.error);
console.log(`Created topic ${t}`);
console.log(`Created topic ${t} with ${numPartitions} partitions`);
}

await admin.disconnect();
Expand Down
4 changes: 2 additions & 2 deletions examples/performance/performance-primitives.js
View file Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ async function runCreateTopics(parameters, topic, topic2, numPartitions) {
topics: [{ topic: t, numPartitions }],
}).catch(console.error);
if (topicCreated) {
console.log(`Created topic ${t}`);
console.log(`Created topic ${t} with ${numPartitions} partitions`);
continue;
}

Expand All @@ -53,7 +53,7 @@ async function runCreateTopics(parameters, topic, topic2, numPartitions) {
{ topic: t, numPartitions },
],
}).catch(console.error);
console.log(`Created topic ${t}`);
console.log(`Created topic ${t} with ${numPartitions} partitions`);
await new Promise(resolve => setTimeout(resolve, 1000)); /* Propagate. */
}

Expand Down

AltStyle によって変換されたページ (->オリジナル) /