I think I have been drinking too much this week and my usually hyper-analytical mind has gotten a bit softened. Nonetheless I will try to put forward a couple assertions, reframe the problem in my own terms, and see if I can bring the question forward by identifying, "What is actually the problem?"
First of all, let's begin with the naive (the etymology of this word is related to the words 'natural' and 'native' rather than connoting 'foolish') point of view that what exists is what occurs in space and time. Without needing to study advanced modern physics, I can still describe my native conception of reality, which is something like 3 dimensions of space and 1 of time, and that there are things inside space. Maybe we can call this existence-1. I claim that there are things, you can call them particles or pieces of matter, and they are endowed with certain properties like mass, charge, spin, position, volume, etc. If we can imagine a set of all conceivable things, we would say a thing has the property exists-1 if and only if it is in the set of particles just described. Therefore, the only thing that exists-1 are these particles. The entire course of the history of the universe, human history, etc., is just a sequence of descriptions of the state of those particles: at any given instant, what their location, energy, force, velocity, acceleration, etc. was. And maybe those particles can also pop in and out of existence during the course of that history.
In this picture of the world, in what sense does my bank account exist? Of course I am inclined to say I really do have a bank account, at the International Bank of Money; it's really there. Well, what is my bank account? Is it made of particles? I think the mental notion I have of my bank account is like a data structure or schema I have in my mind. When I think of my bank account, I can tell you the routing number, the current balance, the date it was opened, which mobile app to download to interact with it, the logo and color scheme of my bank, and so on. Just as this information can be encoded and stored in computer memory, and it can be retrieved or modified by actions on some stateful system (a computer), information can also be encoded in the neural system of my mind, and the stateful system of my brain can be acted on and changed to encode new information, retrieve information that's already there, update pre-existing information, etc. This all corresponds to changes in the stateful properties of the particles, which are the only thing that exists-1. So, I still don't see that there's any problem. When I walk up to a physical location of my bank branch, particles (photons) from the physical mass of that bank (walls, windows, posters, cloth overhangs, which are all made of particles) travel across space into my eyes. My eyes are also made of particles. The photon particles make contact with particles that are in the optic nerve inside my eye. The particles in the optic nerve send other particles - electrons - traveling in a certain direction. When those particles come to a neuron, also made of particles, that neuron is able to trigger more electrons (particles) to travel in a certain direction; and so on. The result is that the system of my mind experiences an image, encodes it in neurons and synapses, etc. So "my bank account" - at least, the concept that I think of when I contemplate those words - is something like a pattern of information encoded in the configuration of particles in my brain.
A lot of the time in philosophical inquiry, I find that the goal is to problematize something. I don't know off the top of my head what problems there are that lead us to need to debate if triangles really exist or not, but I can try to brainstorm some. I think the key question here is, "What is at stake?" If triangles do or do not exist, what are downstream problems that will be affected by this thesis?
I have been studying a little bit of Basic Formal Ontology, and I might try to bring in some concepts from there.
In Basic Formal Ontology, it appears that they acknowledge the distinction between classes of things and instantiations of those classes. As of right now, I think of this as a result of how humans cognize the world, and not at all something inherent to the world itself. The world-engine itself (the system defining and simulating the world) doesn't know what chairs are (it doesn't need the definition of a chair to be able to operate as it currently does). The "theory of the world" only acknowledges primitive entities like subatomic particles in its 'theory'.
If we are to claim that a triangle is a "thing", it seems pretty natural to claim that it also carries the "thing-ness" property of having both a class form and an instance form. Instances tend to be "flesh-and-blood", to speak metaphorically: there is some domain that we emphasize is where "real existence" occurs; instances actually pop up there; that is their locus. Classes do not. Classes are often something above or separate from the plane of "actual performative reality".
We might say the class of all triangles is defined by some properties that every instance of a triangle shares. If we want to use set theory (which I think brings in plenty more weird ontological questions like "what actually are sets?"), maybe we can define 2-dimensional space, then the notion of a line, then talk about how a triangle is more or less the set of points that are amongst the points constituting the line segments that are respectively defined as the part of a line between the intersection points of 2 other lines. So, in pure set theory, what's a triangle? I think a problem is that pure set theory is ontologically dissatisfying. It claims the only thing that exists are "abstract sets", which are "collections of things", except the only things they can be collections of are other such "abstract collections". So maybe this is one small, winsome realization: when we try to formally define any mathematical object, is it still making use of a formal language which still asserts the existence of certain ontological primitives, at the start? I know that the older, original versions of set theory actually assumed the existence of "urelements", which I find a lot more philosophically satisfying: sets are collections of things, and even if we don't need to say what things, there is always the opportunity to look and see what actual thing we are talking about, in any given situation.
Maybe a next point we can consider is, even if we assert certain ontological primitives, like that the world is made of fundamental-element-1, or fundamental-element-2, we might argue that the abstractness of set theory and math makes it clear that whatever a triangle is, it is not going to be bound to a specific ontological realization. It will probably be just as valid regardless of the things it is made of. So here, we encounter the idea that "there is an abstract thing called 'structure'".
In Basic Formal Ontology, there is a notion of a dependent entity. A dependent entity is a thing that does not exist on its own. It requires a host. This also leads to some hard philosophical questions. Is "redness" a thing, in and of itself, or do we only ever regard things which have the property of being red? Maybe there are some examples which make the difference more apparent: an object has a mass (a weight), but we cannot have mass on its own. There is only mass if there is some thing, endowed with true thing-in-itselfness, which is the bearer of that property of having such-and-such mass.
If a triangle is a dependent entity, then it is actually a property of some actually-existing-in-the-world things.
Even if this is the case, I am still not flummoxed by the question "Do mathematical entities exist inherently?" I think when we talk about whether certain mathematical objects exist or not, there are examples of this where sure, it definitely 'matters'. Is there a general formula to solve any quintic polynomial equation? There is not. Such a formula doesn't exist. But maybe we can call this existence-2. Perhaps this is structural existence, or something. A structure requires a host to be realized in - something with real-world ontological existence. But we can still mentally conceive of structures, and talk about which structures are logically feasible or not.
This is pretty amateur and probably superficial, but it's what I came up with today as I continue to engage with this question.