Remove all the image gallery css navigation buttons

Q: Would I be able to remove all the navigation buttons for image gallery css except for the close button

A: Yes, it is possible.
You should open engine/css/visuallightbox.css file and find the following code:

#detailsNav{display:block; float:left;padding:0;}

change it to:

#detailsNav{display:block; float:left;padding:0; display: none;}