2021-09-10 13:30:32
Topic starter
I uploaded a large file. BatchWriteSingleRelationalChunk task is running 1 task at a time ...
I have 3000+ such tasks... is there a configuration available to parallelize it?
To configure, add an entry to EXTERNAL_REFERENCE with:
type = ParallelBatchWrite
key = queue:interface:version, for example "100~inbox:SCC.Item_IB:2.0"
value = number of grid queues to use to process a single message
Sample query -
insert into external_reference (SYS_EXTERNAL_REFERENCE_ID,MODEL_NAME,VC_ID,REF_TYPE,EXTERNAL_VALUE,LOCAL_VALUE) values (EXTERNAL_REFERENCE_SEQ.nextval, 'Standard ExternalReference',(select vc_id from value_chain where vc_id!=0),'ParallelBatchWrite','UploadInboundInterfaceCsvFiles~CMD.UploadOnboardRequest~1.0',10);
* You must register this class through BatchWriteCallback.register from your ModuleContextListener*.
e.g.
BatchWriteCallback.register(new ParallelBatchWriteCallback());
See https://docs.onenetwork.com/devnet/latest/platform-user-s-guide/system-configuration