5,289 questions
- Bountied 0
- Unanswered
- Frequent
- Score
- Trending
- Week
- Month
- Unanswered (my tags)
-4
votes
0
answers
45
views
Apache Nifi: replace text with regex [closed]
I'm trying to build a NiFi pipeline with a ReplaceText processor that will be able to:
Match expressions of the type:
M\t63574
where the character at the M position can be either M or W,
and the ...
0
votes
1
answer
36
views
Remove key from Distributed Map Cache (NiFi)
About DistributeMapCacheClient
I'm trying to use Fetch + Put logic for my scenario. After Put I perform some actions and after them I need to remove this key from cache. I didn't find any processor to ...
0
votes
0
answers
35
views
Apache NIFI 2.5.0 KafkaPublisher can not publish message larger than 30 MB
Apache NIFI 2.5.0 KafkaPublisher can not publish message larger than 30 MB.
I have adjust the Max Request Size to 50MB but still in vain.
The topic on Kafka has config the message size to 50 MB.
I ...
1
vote
0
answers
52
views
NiFi ListS3 Processor SdkClientException: Name or service not known for S3 bucket
I'm setting up an Apache NiFi flow using the ListS3 processor to scan an AWS S3 bucket, but I keep getting errors, and the processor isn't listing any files from the bucket.
NiFi Processor ...
0
votes
0
answers
27
views
NiFi 2.4.0: Dynamically hash selected columns in Parquet records before uploading to GCS
I have a NiFi 2.4.0 pipeline:
GenerateFlowFile -> ExecuteSQLRecord -> PutGCSBucket
ExecuteSQLRecord fetches all table columns and outputs Parquet files.
I want to hash certain columns ...
0
votes
0
answers
41
views
Nifi Apache is not running. Nifi process STOPPED immediately
I was trying to reset login via nifi.properties and now safari can't connect to the server. The status says: Nifi process stopped.
Java is fine, path is fine.
Nifi.properties are newborn fresh.
Tail:
/...
0
votes
0
answers
53
views
NiFi Site-to-Site using cluster spanning zones
I have a NiFi cluster spanning zones (datacentres). I am using a cluster to take advantage of having consistent configs, permissions etc.
In each zone, I have hosts running MiNiFi sending data to the ...
-1
votes
0
answers
63
views
Cassandra integration in NiFi 2.4 [closed]
We upgraded NiFi from 1.16 to 2.4 and now the Cassandra integration is broken. The 1.x processor for Cassandra 5.x is not there and I did not find a solution (even JDBC) for 2.4.
I searched google on ...
0
votes
0
answers
54
views
How to Customize Apache NiFi 2.4.0 API Logging to Include Custom Attributes?
I'm using Apache NiFi 2.4.0 and want to extend the default HTTP request logging (nifi-request.log) to include a custom attribute called logType with values like DATA_ACCESS, DATA_EXPORT, or ...
0
votes
0
answers
43
views
Merge 2 API JSON responses into one based on a unique Id present in both API responses using NiFi Jolt
Merge 2 API JSON responses into one based on a unique Id present in both API responses using NiFi Jolt.
If the Aud_Id not found in both API response, then ignore them in the final output. The merge ...
0
votes
0
answers
77
views
How to read JSON schema file dynamically in apache nifi 2.5.0 to transfer table from oracle to vertica
I am new to nifi. I need to transfer tables in Oracle schema (source) into Vertica schema/user (destination). Each Oracle schema will contain hundreds of tables among which few are very large tables ...
0
votes
0
answers
28
views
Nifi - queryelasticsearchhttp vs jsonqueryelasticsearch
older version of nifi had queryelasticsearchhttp which would have a target as flowfile attribute but it is missing in newer nifi in jsonqueryelasticsearch.
Is there another simpler way to have my ...
0
votes
1
answer
84
views
Get data from two different databases and merge them
I have a task in Apache NiFi
Table 1
ID date client_name attr_client
Table 2
ID date address city active
Table 3 (result table)
ID date client_name attr_client address city
I need to make a query to ...
0
votes
0
answers
42
views
Two diff types of Input Json, but i want a single Jolt Spec to Handle both cases and create a common output
Dynamic Jolt spec to handle both the nested json and single object.
Need a common jolt spec to handle both
Hi,
Here is my input JSON
{
"msg": "success",
"prnum": &...
0
votes
1
answer
103
views
Apache Nifi InvokeHTTP POST Call
I want to create a processor to make a simple Postcall , but it isnt clear on where the Raw body could be put in properties tab. Can anyone please help
Sample Url :http://echo.free.beeceptor.com/...