How do i re-arrange collections in the CMS?

You can always add the extra field (number type of field) to the item for ordering. Then you can add numbers there and filter dynamic collection by that field.

Hope it helps.

Regards,
Anna