[microNPU] Add a pass to reorder copy and compute nodes

[NicolaLancellotti]

This pr adds a pass to reorder Arm(R) Ethos(TM)-U copy and compute nodes in such a way that independent DMA copies, and computes happen in parallel.

cc @lhutton1 @ekalda @manupa-arm

[lhutton1]

Thanks @NicolaLancellotti! Looks good overall, just some small things below

[ekalda]

Looks really good, @NicolaLancellotti! I'd be interested in seeing how that pass interacts with graphs that have mixture of operators with and without weights, e.g. it seems to me that when we have a graph that looks like
pooling -> copy -> copy -> conv2d -> copy -> copy -> depthwise2d
it will end up after this pass as
copy -> copy -> pooling -> copy -> copy -> conv2d ...
I suppose that is intentional, that we start copying the conv2d weights in while the MAC engine is crunching the pooling? Maybe it's worth adding a test that exercises that kind of mixture of ops?

[NicolaLancellotti]

I'd be interested in seeing how that pass interacts with graphs that have mixture of operators with and without weights, e.g. it seems to me that when we have a graph that looks like
pooling -> copy -> copy -> conv2d -> copy -> copy -> depthwise2d
it will end up after this pass as
copy -> copy -> pooling -> copy -> copy -> conv2d ...
I suppose that is intentional, that we start copying the conv2d weights in while the MAC engine is crunching the pooling? Maybe it's worth adding a test that exercises that kind of mixture of ops?

Yes, it is intentional, and the reordering is just what you said. I have added a test too.

[lhutton1]

Nice thanks @NicolaLancellotti! It looks like we need a re-trigger due to the linting issues CI had last week :)

[lhutton1]

LGTM!

[lhutton1]

Looks like it now conflicts with #10344 :/

[NicolaLancellotti]

I have added a parameter to specify the maximum number of movements allowed for a copy.

[manupak]

Thanks @NicolaLancellotti for the great work here.

I've left some comments to improve the code readability and a suggestion to allow PassContext to configure the pass.

[manupak]

LGTM!

[manupak]

Ah just found one thing that needs to be fixed.
Happy to take an immediate follow up. Let me know

[lhutton1]

Thanks @NicolaLancellotti, @manupa-arm, @ekalda!