FastParse - out of memory error

194 views Asked by At

I'm trying to use the FastParse library to create a parser for a very primitive templating system like this:

Hello, your name is {{name}} and today is {{date}}.

So far I have:

scala> import fastparse.all._
import fastparse.all._

scala> val FieldStart = "{{"
FieldStart: String = {{

scala> val FieldEnd = "}}"
FieldEnd: String = }}

scala> val Field = P(FieldStart ~ (!FieldEnd ~ AnyChar).rep.! ~ FieldEnd)
Field: fastparse.all.Parser[String] = Field

scala> val Static = P((!FieldStart ~ !FieldEnd ~ AnyChar).rep.!)
Static: fastparse.all.Parser[String] = Static

scala> val Template = P(Start ~ (Field | Static) ~ End)
Template: fastparse.all.Parser[String] = Template

scala> Template parse "{{foo}}"
res0: fastparse.core.Parsed[String,Char,String] = Success(foo,7)

scala> Template parse "foo"
res1: fastparse.core.Parsed[String,Char,String] = Success(foo,3)

scala> Template parse "{{foo"
res2: fastparse.core.Parsed[String,Char,String] = Failure(End:1:1 ..."{{foo")

But when I try what I think should be the correct final form:

scala> val Template = P(Start ~ (Field | Static).rep ~ End)
Template: fastparse.all.Parser[Seq[String]] = Template

I get:

scala> Template parse "{{foo}}"
java.lang.OutOfMemoryError: Java heap space
  at scala.collection.mutable.ResizableArray$class.ensureSize(ResizableArray.scala:103)
  at scala.collection.mutable.ArrayBuffer.ensureSize(ArrayBuffer.scala:48)
  at scala.collection.mutable.ArrayBuffer.$plus$eq(ArrayBuffer.scala:84)
  at scala.collection.mutable.ArrayBuffer.$plus$eq(ArrayBuffer.scala:48)
  at fastparse.core.Implicits$LowPriRepeater$GenericRepeater.accumulate(Implicits.scala:47)
  at fastparse.core.Implicits$LowPriRepeater$GenericRepeater.accumulate(Implicits.scala:44)
  at fastparse.parsers.Combinators$Repeat.rec$3(Combinators.scala:462)
  at fastparse.parsers.Combinators$Repeat.parseRec(Combinators.scala:489)
  at fastparse.parsers.Combinators$Sequence$Flat.rec$1(Combinators.scala:297)
  at fastparse.parsers.Combinators$Sequence$Flat.parseRec(Combinators.scala:319)
  at fastparse.parsers.Combinators$Rule.parseRec(Combinators.scala:160)
  at fastparse.core.Parser.parseInput(Parsing.scala:374)
  at fastparse.core.Parser.parse(Parsing.scala:358)
  ... 19 elided

What am I doing wrong?

1

There are 1 answers

1
insan-e On BEST ANSWER

Try like this:

val Field = P(FieldStart ~ (!FieldEnd ~ AnyChar).rep(min=1).! ~ FieldEnd)
val Static = P((!(FieldStart | FieldEnd) ~ AnyChar).rep(min=1).!)

val Template = P(Start ~ (Field | Static) ~ End)

You should be careful with .rep, it literally means zero or more...
Also, in the Static parser, the negative lookahead should look like !(FieldStart | FieldEnd),
I think, because you don't want (open braces or closed braces).

Hope it helps! ;)