That season, Derby failed to retain their title, finishing seventh, but reached the semi-finals of the European Cup in April 1973, when they were knocked out by Juventus 3–1 on aggregate. After the game, Clough emerged from the dressing room and told the expectant Italian reporters "No cheating bastards do I talk to. I will not talk to any cheating bastards" and then questioned the Italian nation's courage in the Second World War. It was these sorts of frequent, outspoken comments – particularly against football's establishment, such as the FA and club directors, and figures in the game such as Sir Matt Busby, Alan Hardaker, Alf Ramsey, Don Revie and Len Shipman, along with players such as Billy Bremner, Norman Hunter and Peter Lorimer – combined with Clough's increased media profile, that eventually led to his falling out with the Rams' chairman, Sam Longson, and the Derby County board of directors.
On 5 August 1973, Clough put his name to an article in the Sunday Express which savaged Leeds United's disciplinary record, stating that Don Revie should be fined for encouraging his players in their unsporting behaviour and Leeds relegated to the Second Division. Clough also said that "The men who run football have missed the most marvellous chance of cleaning up the game in one swoop" and went on to say "The trouble with football's disciplinary system is that those who sat in judgement being officials of other clubs might well have a vested interest."
Days afterwards, Clough was charged with bringing the game into disrepute, but he was cleared on 14 November after he had later resigned from Derby. In September 1973, Clough travelled to West Ham United's Upton Park and made a £400,000 bid for Bobby Moore, a player he admired, and Trevor Brooking. West Ham manager Ron Greenwood told Clough that neither was available but that he would pass his offer onto the board of directors. Clough never told either his chairman, secretary or other board members at Derby about the bid. Longson found out four months later during a chance conversation with Eddie Chapman, West Ham's secretary at the time, but by then Clough was no longer the Derby County manager.
On 11 October 1973, Longson called for the sackings of both Clough and Taylor at a board meeting, but did not gain the support that was needed. Earlier that week, Longson had demanded that Clough stop writing newspaper articles and making TV appearances, and had the grille pulled down on the bar to stop both Clough and Taylor drinking. Two days later, following a 1–0 win against Manchester United at Old Trafford, a club director, Jack Kirkland, demanded to exactly know what Taylor's role within the club was and instructed Taylor to meet him at the ground two days later to explain. On the same day, Longson accused Clough of making a V-sign at Sir Matt Busby and chairman Louis Edwards and demanded that he apologise. Clough refused to do so. Clough admitted on the coach journey back that he did make a V-sign but it was aimed at Longson, not Busby or Edwards, over lack of tickets and lack of seating for players' wives, including his own and Taylor's.
Such was the loyalty to Clough that, along with himself and Taylor, scouts and backroom staff completed the walk out, following the pair for their brief spell with Brighton & Hove Albion. He proved less successful on the south coast than with his previous club, winning only 12 of his 32 games in charge of the Division Three side. Whereas eight months earlier Clough was managing a team playing Juventus in the European Cup, he was now managing a club who, just after his appointment as manager, lost to non-league Walton & Hersham 4–0 at home in an FA Cup replay. On 1 December 1973, his side lost 8–2 at home to Bristol Rovers. Albion eventually finished in 19th place that season.