Use the TAB key or click the calendar to apply focus to the calendar.
Then you can navigate the days using the right and left arrow keys.

To select the highlighted day, press the space bar.