I believe the story was about a town librarian and the relationship she formed with a boy who was a "giant". The cover depicted two pair of shoes side by side.
The Giant's House - Elizabeth McCracken
Yes, that is it. I read it last year and it was excellent.
Thank you for your patience