Option 1 (add $default route) did not improve the situation.

Now I am adding an additional route to the HTTP API after CloudFormation/CDK is
finished deploying:
https://github.com/bifravst/aws/commit/ff04fbb19a0a8edf9c6c1efc78da34aa2278ff18
... looks promising so far.