The changes apply to the Photo Albums application, not directly to the Photo Album includelet - though if you are using the includelet then the videos will now show alongside the photos.

So yes, as you've discovered, if you go to the photo albums page, and if you're logged in as an administrator, then you should see the + Add buttons as appropriate.
(These buttons aren't in the admin pages of the site, they are in the photo album pages themselves on the public pages, when you're logged in as someone who has permission to add photos)

Thanks

Joe