If you want clean URLs you must configure NGINX properly, it does not work out of the box. At the very minimum, you must pass every miss through index.php:
location / {
try_files $uri /index.php?$args;
}
For more info, check my modular configuration suggestions or any other tutorial online (there are tons of them).