I agree with what the others have said - it usually means she is small/thin/slightly built
However, depending on what precedes and follows the phrase it might not have any reference to her being beautiful or lovely.

A street urchin or child beggar can be a 'scrap of a thing' as well. Poor and tiny.
It could be used as a compliment but the context would make that much more clear.
Hope this helps.