14 UNAVAILABLE: Request 'AppendRows' from role 'cloud-dataengine-globalrouting' throttled: Task is overloaded (memory-protection) go/tr-t

[brantian]

Hello!

I've been using the Storage Write pending stream to write that successfully, but recently I started getting this error from time to time:

14 UNAVAILABLE: Request 'AppendRows' from role 'cloud-dataengine-globalrouting' throttled: Task is overloaded (memory-protection) go/tr-t

The error is emitted by the connection created by writeClient.createStreamConnection. This is what I'm doing

  const streamId = await writeClient.createWriteStream({ 
      streamType : managedwriter.PendingStream,
      destinationTable : parent
    });

  const connection = await writeClient.createStreamConnection({
        streamId,
      });

  const  writer = new managedwriter.Writer({
      connection,
      protoDescriptor : this.protoDescriptor
    });
  
  writer.appendRows({serializedRows}, offsetValue);

  await writeClient.batchCommitWriteStream({ parent : parent, writeStreams: [writeStreamId!] })

I didn't find much documentation about this specific issue. Can anyone provide guidance on what may be happening or direct me to the corresponding documentation so I can debug it?

What is puzzling me is that this error only happens intermittently. I haven't been able to reproduce it locally, but I see it happening from time to time in my application logs.

Thanks!

[alvarowolfx]

PR #443 will address this kind of error and will either thrown an error on the PendingWrites happening and you can retry them or you can enableWriteRetries and the library will reconnect and try to send the requests again.