In a morally corrupt or depraved manner. He lived degenerately, indulging in all sorts of vices without any regard for the consequences.
In a way that shows a decline from a former or original state. The once beautiful garden was degenerately overgrown and neglected.
In biology, in a manner marked by structural or functional degeneration. Some captive-bred animals develop degenerately, exhibiting reduced survival traits.