Synfig Issue Tracker ~ [CLOSED] #154 - Tremendous memory usage when importing large PNGs

Synfig Issue Tracker

CLOSED Bug report #154 - Tremendous memory usage when importing large PNGs

Posted Dec 22, 2012 - updated Jan 05, 2019

Votes

This issue has been closed with status "Closed" and resolution "RESOLVED".

Issue details

Type of issue

Bug report Unknown issue type
Status

Closed

Status not determined
Assigned to

Not assigned to anyone
Progress
Type of bug

Not triaged
Likelihood

Not triaged
Effect

Not triaged
Posted by

Imported User

Imported User
Offline

This user was last seen online at Dec 28, 2012 - 17:56

Show user details

Close this menu
Owned by

Not owned by anyone
Estimated time

No time Not estimated
Time spent

3 days No time spent
Category

Import Not determined
Resolution

RESOLVED Not determined
Priority

Not determined
Reproducability

Not determined
Severity

Not determined
Targetted for

Not determined
Tags

Not determined
Difficulty

Not determined

Issue description

burginabc: When I import many large (high-res) PNGs into a scene, memory usage shoots up dramatically. My guess as to what's happening is that it is decompressing the PNGs upon import and storing the fully decompressed bitmap data in memory, which is hugely inefficient. Maybe the new Cairo based version you're working on doesn't have this issue and my point is moot because you're working on it anyway, but just want to inform you that the stable release has a huge issue with this.

it's on 64-bit ubuntu 12.10 "quantal" by the way. I have 4 GB of ram and with 15 large (Roughly 2000x2000) PNGs in the scene 3 GB of that memory is used, compared to 300MB while idle.

Steps to reproduce this issue

Nothing entered.

Show system-generated comments

Comment posted by

Charlie Murphy

Jan 01, 21:32

I think keeping it compressed in memory would also be hideously inefficient. It would have to decompress the image on every frame to draw the pixels.

In the meantime you could use low-res placeholders. Before your final render, you can switch them back to the high-res images.

Any other ideas?

Comment posted by

Carlos López

Jan 02, 07:11

Use huge images only where absolutely needed. Render foregrounds separately and compose them with the backgrounds in a video editor. For that, use low resolution images when editing and disable the render of them using the latest feature of render disable option for layers.

Comment posted by

Konstantin Dmitriev

Jan 02, 13:01, in reply to comment #2

Charlie Murphy wrote:

I think keeping it compressed in memory would also be hideously
inefficient.
It would have to decompress the image on every frame to draw the pixels.

In the meantime you could use low-res placeholders. Before your final
render,
you can switch them back to the high-res images.

Any other ideas?

I agree that the memory usage for the images is absolutely ridiculous in Synfig. Using low-res placeholders is not an option in my opinion. I think the images should be purely handled by Cairo loader or something like that. (AFAIK when cairo rendering mode is enabled then cairo loads image by itself, without relying on the image stored in memory. Carlos, please orrect me if I'm wrong. ^__^)

Comment posted by

blackwarthog

Sep 06, 16:50

Fixed https://github.com/blackwarthog/synfig/tree/rendering

Comment posted by

Konstantin Dmitriev

Sep 07, 11:32, in reply to comment #5

blackwarthog wrote:

Fixed
https://github.com/blackwarthog/synfig/tree/rendering

I have tested the solution. For my test with a lot of imported images it now consumes 14 times ( ! ) less memory (100 Mb vs 1400 Mb). Although, the rendering speed now ~2,5 times slower (52ms vs 17 ms). Is it possible to do something about this?

P.S. I have pitched a bounty a bit ^__^ - https://www.bountysource.com/issues/1372043-tremendous-memory-usage-when-importing-large-pngs

Comment posted by

blackwarthog

Sep 10, 16:19, in reply to comment #6

New code uses two methods to reduce image :

 - fixed some bugs :) - reduce some memory;
 - change format from RGBA-Float32 to RGBA-UInt8 - reduce memory 4 times;
 - Gzip-compression - additional reduce memory 2 times.

Gzip-compression takes a lot CPU-time and give approximate 50% compression. So i think we may to make gzip-compression optional. Also i need to tune minimal of image size for gzipping.

Comment posted by

Konstantin Dmitriev

Sep 16, 10:16, in reply to comment #7

Results for test file with the latest changes:

Synfig 1.0.2 - 1.1 Gb
Synfig 1.1.1 (dev) - 1.4 Gb
Current (dev) - 0.4 Gb

The win is 3,5 (comparing to 1.1.1), and 2,75 (comparing to 1.0.2). The slowdown is only 3-4 ms. (comparing to (1.1.1).

Good work! ^__^

Comment posted on behalf of

Konstantin Dmitriev

Sep 16, 10:16

The issue was updated with the following change(s):

This issue has been closed
The status has been updated, from New to Fixed.
This issue's progression has been updated to 100 percent completed.
The resolution has been updated, from Not determined to RESOLVED.
Time spent on this issue, from No time spent to 3 days.

#10

Comment posted on behalf of

Konstantin Dmitriev

Sep 19, 09:30

The issue was updated with the following change(s):

The status has been updated, from Fixed to New.
This issue has been reopened
The resolution has been updated, from RESOLVED to Not determined.
This issue's progression has been updated to 0 percent completed.

#11

Comment posted on behalf of

Konstantin Dmitriev

Sep 19, 09:30

The issue was updated with the following change(s):

This issue has been closed
The status has been updated, from New to Closed.
This issue's progression has been updated to 100 percent completed.
The resolution has been updated, from Not determined to RESOLVED.

#12

Comment posted by

Konstantin Dmitriev

Nov 13, 15:35, in reply to comment #8

Here are the binary builds with memory fix - http://www.synfig.org/cms/en/news/synfig-studio-builds-updated-2/

#13

Comment posted by

yvettemkflt63

Oct 03, 14:39

Maybe the new Cairo based version you're working on doesn't have this issue and my point is moot because you're working on it anyway, but just want to inform you that the stable release has a huge issue with this.

Kitchen Hood Cleaning

#14

Comment posted by

Aria2

Nov 25, 14:19

I can't edit video, no matter how much time I spend on it, it's much easier to give a project to https://crftvideo.com/ and I'm sure I'll get my product with the best quality at the end. For this to me it is commonplace, but those who still do not know about the existence of such companies, I advise to learn in detail.

#15

Comment posted by

moriomhaosn

Feb 25, 15:00

We’re a full-service mobile truck repair company that comes to you. air filter replacements

#16

Comment posted by

justineford43

Jun 23, 04:23

Some businesses have certified arborists and tree surgeons who handle more particular tree issues. However, it is important to first speak with your chosen tree firm about your specific issue. | www.treeserviceofaustin.com/tree-removal

#17

Comment posted by

justineford43

Jun 23, 04:27

Our skilled professionals for austin upholstery cleaning take great care to meticulously clean upholstery and restore its new-looking appearance.

#18

Comment posted by

timothyferriss

Oct 12, 04:44

If your software allows it, you can work on different parts of your project separately and then merge them at a later stage. This can help reduce the immediate memory load 2048

#19

Comment posted by

timothyferriss

Oct 12, 04:44

If your software allows it, you can work on different parts of your project separately and then merge them at a later stage. This can help reduce the immediate memory load 2048

#20

Comment posted by

timothyferriss

Oct 12, 04:45

If your software allows it, you can work on different parts of your project separately and then merge them at a later stage. This can help reduce the immediate memory load 2048

#21

Comment posted by

timothyferriss

Oct 12, 04:45

If your software allows it, you can work on different parts of your project separately and then merge them at a later stage. This can help reduce the immediate memory load 2048

#22

Comment posted by

timothyferriss

Oct 12, 04:45

If your software allows it, you can work on different parts of your project separately and then merge them at a later stage. This can help reduce the immediate memory load

#23

Comment posted by

timothyferriss

Oct 12, 04:45

If your software allows it, you can work on different parts of your project separately and then merge them at a later stage. This can help reduce the immediate memory load

#24

Comment posted by

timothyferriss

Oct 12, 04:45

If your software allows it, you can work on different parts of your project separately and then merge them at a later stage. This can help reduce the immediate memory load

#25

Comment posted by

timothyferriss

Oct 12, 04:45

vxvb

#26

Comment posted by

timothyferriss

Oct 12, 04:46

hnbhjnm

#27

Comment posted by

timothyferriss

Oct 12, 04:46, in reply to comment #17

https://2048go.com

#28

Comment posted by

timothyferriss

Oct 12, 04:47, in reply to comment #17

 https://2048go.com

#29

Comment posted by

timothyferriss

Oct 12, 04:47, in reply to comment #17

https://2048go.com

#30

Comment posted by

timothyferriss

Oct 12, 04:47

hnbhjnm

#31

Comment posted by

timothyferriss

Oct 12, 04:47

#32

Comment posted by

benesh1994disabilit

Apr 28, 07:27

Both residential and commercial properties in the area are serviced by an arborist near me. With trucks, chippers, and other equipment required for a flawless tree-trimming service, we are well prepared.

* Username
* Display name
The "display name" is the name shown to others
Real name
* E-mail address
* Confirm e-mail

Welcome to The Bug Genie

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Really delete this comment?

Username
Password