arXiv++ Combinatorics

Throughout, all graphs are simple, finite and have vertex sets of the form $\{ 0, 1, 2, \ldots, n - 1 \}$ for some $n \in \mathbb{N}$. For graphs $G$ and $H$, and a permutation group $Γ$ on the vertex set of $H$, we say that $H$ is $Γ$-embeddable in $G$ if there exists a graph homomorphism from $H$ to $G$ of the form $ψ\circ \varphi$, where $\varphi \in Γ$ and $ψ$ is an increasing injection. Recently, standard and ordered Ramsey numbers of graphs were unified through the introduction of permutational Ramsey numbers, defined as follows. For graphs $H_1, H_2, \ldots, H_k$ and permutation groups $Γ_1, Γ_2, \ldots, Γ_k$ on their respective vertex sets, the permutational Ramsey number $R(H_1^{Γ_1}, H_2^{Γ_2}, \ldots, H_k^{Γ_k})$ is the minimum $n \in \mathbb{N}$ such that for every $k$-edge-coloring of a complete graph on $n$ vertices, there exists some $j \in \{1, 2, \ldots, k\}$ for which $H_j$ is $Γ_j$-embeddable in the spanning subgraph of the complete graph comprising the edges of color $j$. Here, we consider reflective (resp. dihedral) Ramsey numbers, which are a specific class of permutational Ramsey numbers in which each group $Γ_j$ is the reflection group (resp. dihedral group) on the naturally ordered vertex set of $H_j$. Focusing on the two-color case, we apply the SAT-based approach originally proposed by Poljak for ordered Ramsey numbers and recently extended to cyclic Ramsey numbers. We utilize the Kissat SAT solver to obtain exact values and lower bounds for small reflective and dihedral Ramsey numbers whose two arguments belong to the following graph classes: monotone and alternating paths, monotone cycles, start-central stars, complete graphs and nested matchings. We also derive several general results and formulate conjectures based on the computational findings.

Reinforcement learning (RL) is a subfield of machine learning that focuses on developing models that can autonomously learn optimal decision-making strategies over time. In a recent pioneering paper, Wagner demonstrated how the Deep Cross-Entropy RL method can be applied to tackle various problems from extremal graph theory by reformulating them as combinatorial optimization problems. Subsequently, many researchers became interested in refining and extending the framework introduced by Wagner, thereby creating various RL environments specialized for graph theory. Moreover, a number of problems from extremal graph theory were solved through the use of RL. In particular, several inequalities concerning the Laplacian spectral radius of graphs were refuted, new lower bounds were obtained for certain Ramsey numbers, and contributions were made to the Turán-type extremal problem in which the forbidden structures are cycles of length three and four. Here, we present Reinforcement Learning for Graph Theory (RLGT), a novel RL framework that systematizes the previous work and provides support for both undirected and directed graphs, with or without loops, and with an arbitrary number of edge colors. The framework efficiently represents graphs and aims to facilitate future RL-based research in extremal graph theory through optimized computational performance and a clean and modular design.