It took me a while to find this, so I'm just blogging it so other people will be able to find it.
With the following snippet, I managed to do it.
n = pynotify.Notification(summary="Summary", message="Message!")
Note that the use of a Label is just to have a widget instanciated to use the render_icon() method. It could be any widget type as far as I understand.