fix: remove special case for aarch64 #150

Job	Run time
Clippy	2m 13s
Test on GPUs	10m 35s
Checking fmt	6s
Test on GPUs (--ignored)	15m 45s
Build with various GPU support enabled	9m 51s
Test ignored in release mode	2m 42s
Test in release mode on MacOS	25m 46s
Test without default features	9m 11s
Test in release mode	16m 20s
Test in release mode (--features fixed-rows-to-discard)	16m 36s
	1h 49m 5s

Provide feedback