Next, we took the public ferry to Algiers Point. The Algiers neighborhood, New Orleans' second oldest, sits just across the Mississippi from the Quarter.