Generally, you can never pay a "referral fee" on a real estate transactions. Fees must only be for services actually rendered, and in-line with market costs.
Borrower credits are different from referrals. You may offer promotional discounts (such as $500 credit towards your appraisal fees if you apply by 1/31/2025). Those promotions may not come from the loan originator's commission, nor can they be added to loan pricing to offset the cost. These promotions may only be offered by the company, not the loan originator directly. They must be offered to all customers. Loan amount tiers may not apply.
There are also state prohibitions on this kind of promotion - what states will this be offered in? Some states see through the "raise your rate to cover your costs scheme." So it must be a true discount. You cannot change the pricing structure to gain more income to pay for the credit.
There may be issues when increasing the rate to cover costs. In a rising rate environment, the credit may cause the loan to become a Higher Priced Mortgage Loan.
If a transaction is already receiving seller credits, the broker credit may conflict with the maximum seller contribution, so on a 95% LTV loan with the seller giving 3% credit, there is no room for a broker credit.