aorth 8 hours ago

On one of my sites I received a million requests from Googlebot before lunchtime today. Those requests were spread over hundreds of IPs. I get similar traffic from them and other hyper scalers daily. I'm just one guy. I don't have load balancers and endless engineering budget. I'm sick of this.

  • phreeza 3 hours ago

    Do they not respect the crawl-delay directive in robots.txt?

DeathArrow 8 hours ago

Maybe Google doesn't want people to reach businesses from search results and they want businesses to pay for ads so people can reach them.

  • slowmovintarget an hour ago

    Maybe?

    Search hasn't been search for a long time. It's been a dynamic feed masquerading as search results.

ggm 9 hours ago

Surely if you're dependent on search, you don't HAVE organic business no matter that they call it organic search traffic? "that thing I get from whosit but I don't recall them yea them" is kind of always going to be very variable.

That said a colleague said when his brother-in-law stopped paying for placement his printer/toner supply business tanked, despite him believing they knew who he was. Nobody knows anyone.

iamthepieman 6 hours ago

If you can afford it, please try kagi[0]. It's not a panacea. It IS a lot better than Google and has been for some time.

[0] https://kagi.com/welcome

DeathArrow 8 hours ago

Everyone is complaining about Google since years ago. But no one has built a good alternative. Is it a bad business idea?

  • selivanovp 8 hours ago

    Good alternatives exist, like Yandex. But it's close to impossible to compete with google's resources and platform lock in Android and chrome.

RoderickBeck 9 hours ago

Machine learning is by definition a black box. Nonlinear statistical models with huge numbers of parameters to be estimated.

  • DeathArrow 8 hours ago

    Not all machine learning. Neural networks.

  • openrisk 8 hours ago

    Explainability towards users is essential if there is any sort of responsibility for what the model produces.

    But explainability at a deeper level is also critical towards developers, to close the feedback loop and iterate towards better models.

josefritzishere 4 hours ago

At some point, their business model being replicable, they plant the seeds for their own future compeition.