Piwigo.org

You are not logged in. (Register / Login)

Announcement

#1 2015-11-20 17:34:43

plg
Piwigo Team
Location: Nantes, France, Europe
Registered: 2002-04-05
Posts: 12968
Website

Piwigo Remote Sync, alpha version

Hi Piwigo community,

Here comes Piwigo Remote Sync, a new uploader for Piwigo by mhelleboid. It works very simply: give the web address of your Piwigo, your username and password, your photo local folder on your computer and click the "sync" button. Piwigo Remote Sync will automatically create albums based on your folders. You can run the synchronization many times: Piwigo Remote Sync will only upload new albums and photos.

http://piwigo.org/forum/showimage.php?pid=161367&filename=piwigoremotesync-0.0.9.png

Piwigo Remote Sync works on Windows, Mac and Linux.

Piwigo Remote Sync is available in alpha version (current version 0.0.9). We need you to beta-test it, or maybe alpha-test, actually. If possible, for the first tests, use it on a fresh Piwigo and not on your live Piwigo. You can create a Piwigo.com account for example. Download remotesync-ui.jar and double click it.

Links:
* Piwigo Remote Sync
* releases page on Github, download remotesync-ui.jar and double-click it

Happy beta-testing :-)


Uploaded Images


Latest blog post (March 23th 2017) Piwigo.com Enterprise plans, now official!

Offline

#2 2015-11-20 17:36:38

plg
Piwigo Team
Location: Nantes, France, Europe
Registered: 2002-04-05
Posts: 12968
Website

Re: Piwigo Remote Sync, alpha version

Piwigo Remote Sync works quite the same way as Piwigo Import Tree with a few very important differences:

1) relies on Java instead of Perl which makes it much easier to use on any operating system

2) comes with a basic graphical interface instead of command line


Latest blog post (March 23th 2017) Piwigo.com Enterprise plans, now official!

Offline

#3 2015-11-25 00:21:08

TimMcB
Guest

Re: Piwigo Remote Sync, alpha version

Great idea, can't wait to try it out. Thanks for all the hard work you guys continue to put into developing Piwigo.

#4 2015-11-25 00:29:07

samwilson
Member
Location: Fremantle, Western Australia
Registered: 2014-02-06
Posts: 15

Re: Piwigo Remote Sync, alpha version

This sounds like a great idea; thanks for sending out the newsletter about it. It's nice to get some news of Piwigo. :)

I'm going to try it myself as soon as I can, but one question about Piwigo Remote Sync: after photos have been sync'd, if they are then removed from the local folder are they also removed from Piwigo? (I'm assuming not.)

Thanks! :-)

Offline

#5 2015-11-28 23:39:01

CasN
Member
Registered: 2015-11-16
Posts: 5

Re: Piwigo Remote Sync, alpha version

I had to do a re-install so decided to give it a try.
Problem is I can not get connected.
This is the logfile:
[INFO] User admin will sync gallery https://10.31.1.75/piwigo with directory x:\
[INFO] will create album for x:\Other
[INFO] Connecting...
[ERROR] Unable to connect : Unable to read response content
[ERROR] Error in sync
[INFO] Finished

I have a virgin website running via https, credentials are ok.
Any clue ?

In addition used the debug option which gave this:
[DEBUG] RemotesyncUI sync button action finished
[DEBUG] running false
[INFO] User admin will sync gallery https://10.31.1.75/piwigo with directory x:\
[DEBUG] x:\.piwigo_import_tree.txt doesn't exist
[DEBUG] x:\Other\.piwigo_import_tree.txt doesn't exist
[INFO] will create album for x:\Other
[INFO] Connecting...
[ERROR] Unable to connect : Unable to read response content
[ERROR] Error in sync
[INFO] Finished

Text from the commandline is slightly different:
c:\temp> java -jar /temp/remotesync-ui.jar -debug
10:28:17.234 [main] DEBUG o.piwigo.remotesync.api.AbstractMain - Debug is enabled
10:28:17.234 [main] DEBUG o.p.r.api.conf.ConfigurationUtil - found userConfig file C:\Users\Cas\.config\piwigo\remotesync
10:28:17.468 [main] DEBUG o.p.r.api.conf.ConfigurationUtil - configuration loaded
10:28:17.734 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - Initialize RemotesyncUI window
10:28:17.890 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - RemotesyncUI window initialized
10:28:18.218 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - RemotesyncUI window created
10:28:33.894 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - RemotesyncUI sync button pressed
10:28:33.894 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - RemotesyncUI sync button action finished
10:28:33.894 [Thread-2] DEBUG org.piwigo.remotesync.api.Job - running false
10:28:33.894 [Thread-2] INFO  o.piwigo.remotesync.api.sync.SyncJob - User admin will sync gallery https://10.31.1.75/piwigo with directory x:\
10:28:33.930 [Thread-2] DEBUG o.p.remotesync.api.cache.LegacyCache - x:\.piwigo_import_tree.txt doesn't exist
10:28:34.006 [Thread-2] DEBUG o.p.remotesync.api.cache.LegacyCache - x:\Other\.piwigo_import_tree.txt doesn't exist
10:28:34.008 [Thread-2] INFO  o.p.r.api.sync.SyncDirectoryWalker - will create album for x:\Other
10:28:34.009 [Thread-2] INFO  o.p.r.api.sync.ConnectedWalker - Connecting...
10:28:34.768 [Thread-2] ERROR o.p.r.api.sync.ConnectedWalker - Unable to connect : Unable to read response content
10:28:34.784 [Thread-2] ERROR o.piwigo.remotesync.api.sync.SyncJob - Error in sync
org.apache.commons.io.DirectoryWalker$CancelException: Unable to connect
        at org.piwigo.remotesync.api.sync.ConnectedWalker.connect(ConnectedWalker.java:47) ~[remotesync-ui.jar:0.0.11]
        at org.piwigo.remotesync.api.sync.ConnectedWalker.createAlbum(ConnectedWalker.java:79) ~[remotesync-ui.jar:0.0.11]
        at org.piwigo.remotesync.api.sync.SyncDirectoryWalker.handleDirectoryStart(SyncDirectoryWalker.java:59) ~[remotesync-ui.jar:0.0.11]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:353) ~[remotesync-ui.jar:0.0.11]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:364) ~[remotesync-ui.jar:0.0.11]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:335) ~[remotesync-ui.jar:0.0.11]
        at org.piwigo.remotesync.api.sync.SyncDirectoryWalker.walk(SyncDirectoryWalker.java:81) ~[remotesync-ui.jar:0.0.11]
        at org.piwigo.remotesync.api.sync.SyncJob.doExecute(SyncJob.java:34) ~[remotesync-ui.jar:0.0.11]
        at org.piwigo.remotesync.api.Job.execute(Job.java:30) [remotesync-ui.jar:0.0.11]
        at org.piwigo.remotesync.api.Job$1.run(Job.java:42) [remotesync-ui.jar:0.0.11]
        at java.lang.Thread.run(Unknown Source) [na:1.8.0_31]
10:28:34.784 [Thread-2] INFO  o.piwigo.remotesync.api.sync.SyncJob - Finished

Hope this helps,
Cas

Last edited by CasN (2015-11-29 10:32:29)

Offline

#6 2015-11-29 14:08:08

mhelleboid
Member
Registered: 2015-11-29
Posts: 4

Re: Piwigo Remote Sync, alpha version

Please use version 0.0.12: https://github.com/Piwigo/Piwigo-Java/r … ag/v0.0.12
At first without checking the "trust self signed certificate option", see if the message is clear and tell me (here [Github] Piwigo-Java issue #1 if possible)
Then check the option, and try again

Offline

#7 2015-12-03 22:26:15

CasN
Member
Registered: 2015-11-16
Posts: 5

Re: Piwigo Remote Sync, alpha version

Ok, tried it with the latest version, again on a vanilla install.
Here is the debug outpit from the commandline, hope you can make some sense out of this log.
Thanks,
Cas

C:\temp> java -jar /temp/remotesync-ui.jar -debug
22:22:48.715 [main] DEBUG o.piwigo.remotesync.api.AbstractMain - Debug is enabled
22:22:48.731 [main] DEBUG o.p.r.api.conf.ConfigurationUtil - found userConfig file C:\Users\Cas\.config\piwigo\remotesync
22:22:48.840 [main] DEBUG o.p.r.api.conf.ConfigurationUtil - configuration loaded
22:22:48.887 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - Initialize RemotesyncUI window
22:22:48.934 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - RemotesyncUI window initialized
22:22:48.997 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - RemotesyncUI window created
22:23:01.012 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - RemotesyncUI sync button pressed
22:23:01.012 [AWT-EventQueue-0] DEBUG o.p.remotesync.ui.swing.RemotesyncUI - RemotesyncUI sync button action finished
22:23:01.012 [Thread-2] DEBUG org.piwigo.remotesync.api.Job - running false
22:23:01.012 [Thread-2] INFO  o.piwigo.remotesync.api.sync.SyncJob - User admin will sync gallery http://10.31.1.75/piwigo with directory x:\
22:23:01.028 [Thread-2] DEBUG o.p.remotesync.api.cache.LegacyCache - x:\.piwigo_import_tree.txt doesn't exist
22:23:01.122 [Thread-2] DEBUG o.p.r.api.sync.SyncDirectoryWalker - album already in cache : x:\Other
22:23:01.201 [Thread-2] DEBUG o.p.r.api.sync.SyncDirectoryWalker - album already in cache : x:\Other\19052007
22:23:10.415 [Thread-2] INFO  o.p.r.api.sync.SyncDirectoryWalker - will upload image for x:\Other\19052007\IMG_0788.jpg in album with id 2
22:23:10.415 [Thread-2] INFO  o.p.r.api.sync.ConnectedWalker - Connecting...
22:23:10.978 [Thread-2] INFO  o.p.r.api.sync.ConnectedWalker - Connect successful
22:23:12.384 [Thread-2] DEBUG o.p.remotesync.api.client.WSClient - XmlContent : <br />
<b>Warning</b>:  md5_file(): Filename cannot be empty in <b>/var/www/html/piwigo/admin/include/functions_upload.inc.php</b> on line <b>170</b><br />
<br />
<b>Warning</b>:  getimagesize(): Filename cannot be empty in <b>/var/www/html/piwigo/admin/include/functions_upload.inc.php</b> on line <b>221</b><br />
forbidden file type
22:23:12.399 [Thread-2] DEBUG o.p.remotesync.api.client.WSClient - Class : org.piwigo.remotesync.api.response.ServerResponse
22:23:12.415 [Thread-2] ERROR o.p.remotesync.api.client.WSClient - Unable to parse response
org.simpleframework.xml.core.ValueRequiredException: Unable to satisfy @org.simpleframework.xml.Attribute(name=stat, required=true, empty=) on field 'status' public java.lang.String org.piwigo.remotesync.api.response.BasicResponse.status for class org.piwigo.remotesync.api.response.ServerResponse at line 1
        at org.simpleframework.xml.core.Composite.validate(Composite.java:644) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite.readAttributes(Composite.java:416) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite.access$300(Composite.java:59) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite$Builder.read(Composite.java:1382) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite.read(Composite.java:201) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite.read(Composite.java:148) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Traverser.read(Traverser.java:92) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:625) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:606) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:584) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:562) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:499) ~[remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.client.WSClient.parseResponse(WSClient.java:204) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.client.WSClient.doSendRequest(WSClient.java:96) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.client.AbstractClient.sendRequest(AbstractClient.java:26) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.client.WSClient.sendRequest(WSClient.java:75) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.sync.ConnectedWalker.createImage(ConnectedWalker.java:97) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.sync.SyncDirectoryWalker.handleFile(SyncDirectoryWalker.java:76) [remotesync-ui.jar:0.0.12]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:367) [remotesync-ui.jar:0.0.12]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:364) [remotesync-ui.jar:0.0.12]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:364) [remotesync-ui.jar:0.0.12]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:335) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.sync.SyncDirectoryWalker.walk(SyncDirectoryWalker.java:81) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.sync.SyncJob.doExecute(SyncJob.java:34) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.Job.execute(Job.java:30) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.Job$1.run(Job.java:42) [remotesync-ui.jar:0.0.12]
        at java.lang.Thread.run(Unknown Source) [na:1.8.0_31]
22:23:12.415 [Thread-2] ERROR o.p.r.api.sync.ConnectedWalker - Cannot updload image for x:\Other\19052007\IMG_0788.jpg
org.piwigo.remotesync.api.exception.ClientException: Unable to parse response
        at org.piwigo.remotesync.api.client.WSClient.parseResponse(WSClient.java:210) ~[remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.client.WSClient.doSendRequest(WSClient.java:96) ~[remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.client.AbstractClient.sendRequest(AbstractClient.java:26) ~[remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.client.WSClient.sendRequest(WSClient.java:75) ~[remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.sync.ConnectedWalker.createImage(ConnectedWalker.java:97) ~[remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.sync.SyncDirectoryWalker.handleFile(SyncDirectoryWalker.java:76) [remotesync-ui.jar:0.0.12]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:367) [remotesync-ui.jar:0.0.12]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:364) [remotesync-ui.jar:0.0.12]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:364) [remotesync-ui.jar:0.0.12]
        at org.apache.commons.io.DirectoryWalker.walk(DirectoryWalker.java:335) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.sync.SyncDirectoryWalker.walk(SyncDirectoryWalker.java:81) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.sync.SyncJob.doExecute(SyncJob.java:34) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.Job.execute(Job.java:30) [remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.Job$1.run(Job.java:42) [remotesync-ui.jar:0.0.12]
        at java.lang.Thread.run(Unknown Source) [na:1.8.0_31]
Caused by: org.simpleframework.xml.core.ValueRequiredException: Unable to satisfy @org.simpleframework.xml.Attribute(name=stat, required=true, empty=) on field 'status' public java.lang.String org.piwigo.remotesync.api.response.BasicResponse.status for class org.piwigo.remotesync.api.response.ServerResponse at line 1
        at org.simpleframework.xml.core.Composite.validate(Composite.java:644) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite.readAttributes(Composite.java:416) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite.access$300(Composite.java:59) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite$Builder.read(Composite.java:1382) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite.read(Composite.java:201) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Composite.read(Composite.java:148) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Traverser.read(Traverser.java:92) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:625) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:606) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:584) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:562) ~[remotesync-ui.jar:0.0.12]
        at org.simpleframework.xml.core.Persister.read(Persister.java:499) ~[remotesync-ui.jar:0.0.12]
        at org.piwigo.remotesync.api.client.WSClient.parseResponse(WSClient.java:204) ~[remotesync-ui.jar:0.0.12]
        ... 14 common frames omitted
22:23:12.495 [Thread-2] INFO  o.p.r.api.sync.SyncDirectoryWalker - will upload image for x:\Other\19052007\IMG_0798.jpg in album with id 2
22:23:13.137 [AWT-EventQueue-0] DEBUG o.p.r.api.conf.ConfigurationUtil - found userConfig file C:\Users\Cas\.config\piwigo\remotesync
22:23:13.139 [AWT-EventQueue-0] DEBUG o.p.r.api.conf.ConfigurationUtil - configuration written

Offline

#8 2015-12-04 01:32:22

mhelleboid
Member
Registered: 2015-11-29
Posts: 4

Re: Piwigo Remote Sync, alpha version

Which piwigo version are you using?

Last edited by mhelleboid (2015-12-04 01:32:50)

Offline

#9 2015-12-04 09:08:03

CasN
Member
Registered: 2015-11-16
Posts: 5

Re: Piwigo Remote Sync, alpha version

As you suggested, latest version from github Version 0.0.12

Offline

#10 2015-12-07 20:41:41

mhelleboid
Member
Registered: 2015-11-29
Posts: 4

Re: Piwigo Remote Sync, alpha version

and which piwigo webapp version?

Offline

#11 2015-12-07 22:18:28

Cas
Guest

Re: Piwigo Remote Sync, alpha version

I am using the latest version 2.7.4

#12 2016-01-24 22:57:51

patman
Member
Registered: 2016-01-24
Posts: 12

Re: Piwigo Remote Sync, alpha version

Could you please support local synchronization of files, where no upload of a file is required.

- I normally store my files on my host, using an NFS mounted file system. Having to copy the files is annoying, especially when I have a couple of gigabytes of data.

- I prefer to keep my photos in a separate directory, such that the directories can be accessed in a reasonable way, and so that I know my photos have permissions such that my web server can't modify or delete them.

- I'd like to be able to synchronize with piwigo via the command line.

- I've been having a difficult time trying to switch to piwigo by using a copy of my existing photos (about 1200 albums, with about 29,000 photos). If I could use a synchronization tool that runs on the local files, that would probably help speed things up for me (and others in the future).

I looked into trying to modify piwigo_import_tree.pl to run using local files, but so far that hasn't gone well :-(

Thanks ...

-- Patrick

Offline

#13 2016-03-09 12:10:23

heat7
Member
Registered: 2016-03-08
Posts: 1

Re: Piwigo Remote Sync, alpha version

patman wrote:

Could you please support local synchronization of files, where no upload of a file is required.

- I normally store my files on my host, using an NFS mounted file system. Having to copy the files is annoying, especially when I have a couple of gigabytes of data.

- I prefer to keep my photos in a separate directory, such that the Bathmate directories can be accessed in a reasonable way, and so that I know my photos have permissions such that my web server can't modify or delete them.

- I'd like to be able to synchronize with piwigo via the command line.

- I've been having a difficult time trying to switch to piwigo by using a copy of my existing photos (about 1200 albums, with about 29,000 photos). If I could use a synchronization tool that runs on the local files, that would probably help speed things up for me (and others in the future).

I looked into trying to modify piwigo_import_tree.pl to run using local files, but so far that hasn't gone well :-(

Thanks...

-- Patrick

+1 for local synchronization files. It's much better than having to upload files all the time.

Could this be added soon?

Last edited by heat7 (2016-05-18 21:00:53)

Offline

#14 2016-03-11 07:16:08

drbubbles
Member
Registered: 2015-07-02
Posts: 7

Re: Piwigo Remote Sync, alpha version

If the photo files are local you can just put a symbolic link to their root directory in you piwigo "galleries" directory and then do a normal sync and piwigo will create your album with the same structure to match your photos directory structure. It is really quick too! Is this what you were asking for?

Offline

#15 2016-05-05 14:03:23

r.orrison
Member
Registered: 2014-12-05
Posts: 12

Re: Piwigo Remote Sync, alpha version

Hi,

This stopped working for me with 2.8, still isn't working with 2.8.1.  I've reported it on github ([Github] Piwigo-Java issue #3).  Is it working for anyone else on 2.8 or newer?

Code:

[INFO] User randy will sync gallery https://orrison.com/gallery with directory D:\Piwigo
[INFO] will create album for D:\Piwigo\Slides1960s
[INFO] Connecting... 
[INFO] Connect successful
[ERROR] Unable to parse response
[ERROR] Cannot create album for D:\Piwigo\Slides1960s
[INFO] will upload image for D:\Piwigo\Slides1960s\01-59-001.JPG in album with id null
[ERROR] Unable to parse response
[ERROR] Cannot updload image for D:\Piwigo\Slides1960s\01-59-001.JPG
[INFO] will upload image for D:\Piwigo\Slides1960s\02-59-002.JPG in album with id null
[ERROR] Unable to parse response

Randy

Offline

Board footer

Powered by FluxBB

github twitter facebook google+ newsletter Donate Piwigo.org © 2002-2017 · Contact