Tips for tracing surnames adopted after manumission?

Several folks in my tree seem to have taken a former enslaver's surname after being freed. What sources help confirm that pattern beyond a shared last name?