Hi,
I think you have to assign to the second level of manager otherwise if you are going with the workflows which checks for the relationship(A/B 002) then system will throw an error.
So in case you are using workflows based upon the relationship then i suggest you to maintain the relationship for the employee with the second level of manager.
Regards,
Mithun K