The term "you silly goose" has been around for a long time. Recently one of my historical writer buds was asked to verify the use of this expression to a copy editor. The copy editor thought it was too modern of an expression. To the copy editor's credit, it would have been my first thought too because it is an expression we still use. However, it turns out that the use of this expression was used before 1826 and all the way through the 19th century. Below is a list I sent my friend with the proof of the expression based on the copyrights of the works.
1826 The london literary gazette and journal of belles letters, arts... pg.70 (And another publication same year, same story)
1846 A Dictionary of the English & German, and the German and English... Vol. 2 pg 407
1866 Saturday Reader Vol 2 pg 53
1869 Once a Week pg 131
I'm sharing this with all of you to point out that when researching and writing historicals we might use an expression that is historically correct but might not be thought of as historical. To check on expression type the expression in quotes and search libraries like google books. Narrow the search by selecting free books and 19th century (If that is the time period you are writing in.) and see if the expression you wish to use was used then.
Another point to remember: Editor's still might ask you to change the expression because they feel it might jar the reader out of the story even though you know you are historically accurate. In which case, you change the expression. I try to write expressions that are unique to the character, their surroundings and their personality. Sometimes I've come up with more powerful expressions for my characters. Other times, a common expression is the way to go because the reader zooms right past and doesn't require additional musing over your word choice. In the end work it out with your editor and be true to your story and characters.